Big Data/ML Platform Engineer
Clarity AI, Spain

Experience
1 Year
Salary
0 - 0
Job Type
Job Shift
Job Category
Traveling
No
Career Level
Telecommute
No
Qualification
Unspecified
Total Vacancies
1 Job
Posted on
Apr 9, 2021
Last Date
May 9, 2021
Location(s)

Job Description

Clarity’s mission is to bring social impact to the market. Through our proprietary methodology, we are gaining a deeper understanding of the needs of the population and how to cover them more efficiently in order to better allocate capital to those most important needs. Therefore, we are creating a highly disruptive tech tool to systematically measure and optimize the social impact of investment portfolios powered by big data and machine learning algorithms.

People at Clarity don’t "talk" about ethics and values, we "live" values by example. Our international team is constantly embracing the challenge, solving problems, driven by the purpose of helping investors optimize the social impact of their portfolios. Together, we can become the Gold Standard offering solutions to all society stakeholders we're just getting started.

Would you like to join an international and fast-growing Startup where you can play an important part in shaping its future? How about an opportunity to take part in next-generation social impact solutions in a highly collaborative work environment, where space for professional development is taken very seriously? Interesting, right? Keep reading!


What are we looking for?

In short, we are looking for a Platform Engineer with experience in Big Data and Machine Learning infrastructure; a passionate person with a small amount of experience working in a Platform team following a DevOps philosophy.

If building a reliable platform, that supports and boosts the development of Clarity AI's products in a sustainable way excites you, or if you have a constant need to learn better ways of doing your work, you’ll probably want to keep reading this.

We will love to see that these topics look familiar to you:

  • IAC concepts
  • Configuration Management concepts
  • Monitoring amp; Observability principles
  • Some knowledge or experience using containers and containers schedulers
  • Some knowledge or experience of AWS cloud platform
  • Some knowledge on Big Data and Machine learning common infrastructure
  • Working proficiency and communication skills in verbal and written English

What does our stack look like?

At this moment we have a hybrid architecture between the monolith and some microservices. We are thoroughly moving to a new architecture that may be closer to the microservices proposal and we would love to have you helping us.

We’re handling several stacks, like Java, node.js, Vue, and a good bunch of python at this moment, and we use MongoDB as the main storage system, but we would love to mix this approach with redshift in a while.

We use Redis as a distributed real-time database/cache and RabbitMQ for communications between some asynchronous services.

Requirements

What do we need from you?

  • Help us to improve our platform (Improving dev experience, reliability, scalability) using a lean approach.
  • Help us to create a data platform and infrastructure optimized for developments using Machine Learning and massive data processing.
  • Help us to improve the Data Engineering and Data Science development experience.
  • Help us improve our delivery cadence for ML related products.
  • Help us to spread the DevOps culture in the company.


Our ideal candidate:

  • Has from 4 to 8 years of experience.
  • Has some previous experience with cloud-based services like AWS, Azure, or Google Cloud
  • Has worked with Linux systems in production
  • Has some development experience using python
  • Has some experience with Python Ecosystem for Data Science
  • Has knowledge or experience with two or more of these technologies:
    • AWS EMR or other BigData Platform
    • Airflow, Luigi, or other ETL/workflow scheduler
    • Aws Sagemaker, MLflow, kubeflow, or other ML platforms
    • Aws Redshift or other data warehouses
  • Has worked with relational or non-relational databases
  • Is eager to learn in a collaborative team environment
  • Has an interest in the DevOps engineering culture and practices
  • Is able to identify and communicate problems to the team
  • Pairs effectively with other team members
  • Has a small amount of experience in one technology used by Clarity (Terraform, k8s, GitLab)
  • Is able to ask for help when needed
  • Lean/agile mindset

Benefits

What We Offer:

People are one of Clarity’s main assets. We have built a unique team and we all share 3 differential aspects: Excellence,

Passion and Values.

  • The team comprises professionals from leading consulting and banking firms, MBA graduat

Job Specification

Job Rewards and Benefits

Clarity AI

Information Technology and Services - San Jose, United States
© Copyright 2004-2024 Mustakbil.com All Right Reserved.