Big Data Engineer (Java/Scala/AWS)

Ключевые навыки

Job Overview

ClearScale is looking for an AWS Cloud Engineer to participate in a large-scale cloud migration project. We are hiring for the 2-year-long project related to migration from third-party cloud to AWS, including legacy applications re-factoring to micro service architecture and using cloud-native AWS services.

You will become part of a large distributed engineering team that is responsible for preparing infrastructure, re-hosting the apps, re-design, load testing, live migration of high-load applications, workload optimization, and operational support.

This would be a mass migration led by ClearScale with thousands of servers on the inventory list. The technologies include Redshift, Kinesis, Kinesis Analytics, Aurora, DocumentDB, DB2, Oracle, Mongo, Hadoop/Spark, MSSQL, Kafka, Elasticsearch, Solr, Redis, Mesos/Marathon, Kubernetes (EKS), and many more.

Responsibilities

• Analyze, scope and estimate tasks, identify technology stack and tools
• Design and implement optimal architecture and migration plan
• Develop new and re-architecture solution modules, re-design and re-factor program code
• Specify the infrastructure and assist DevOps engineers with provisioning
• Examine performance and advise necessary infrastructure changes
• Communicate with client on project-related issues
• Collaborate with in-house and external development and analytical team

Qualifications

ClearScale expects successful candidate to have most of the following qualifications and skills (not necessary all have to be presented):

• Hands-on experience designing efficient architectures for high-load enterprise-scale applications or ‘big data’ pipelines
• Practical experience in implementing of micro-services architectures (using Java or Scala stack)
• Hands-on experience with message queuing, stream processing and highly scalable ‘big data’ stores
• Advanced knowledge and experience working with SQL and noSQL databases
• Proven experience in re-design and re-architecting of the large complex business applications
• Strong self-management and self-organizational skills
• Successful candidates should have experience with any of the following software/tools (not all required at the same time):
  • Java/Scala - strong knowledge
  • Relational SQL and NoSQL databases, including PostgreSQL, Oracle, DB2, MongoDB, Cassandra, Couchbase, Redis and Elasticsearch
  • Big data tools: Kafka, Spark, Hadoop (HDFS3, YARN2,Tez, Hive, HBase)
  • Stream-processing systems: Kinesis Streaming, Spark-Streaming, Kafka Streams, Kinesis Analytics
  • AWS cloud services: EMR, RDS, MSK, Redshift, DocumentDB, Lambda
  • Message queue systems: ActiveMQ, RabbitMQ, AWS SQS
  • Federated identity services (SSO): Okta, AWS Cognito
• We are looking for a candidate with 5+ years of experience in Data, Cloud or Software Engineer role, who has attained a degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
• Valid AWS certificates would be a great plus

You’ll be a great fit if:

• You'd like to work remotely with a flexible schedule
• You thrive in a small, dynamic, and agile team that encourages you to learn and grow
• You desire to work with some of the world’s top brands
• You enjoy finding solutions to interesting problems and figuring out how things work
• You welcome having autonomy with complex tasks
• You are passionate about using your experience and expertise to inspire the team

We offer:

• High compensation paid every two weeks in USD;
• Completely remote work: we trust our employees to work from anywhere they please;
• Very flexible schedule consisting of 40 hours per week, Slack for communication;
• Bureaucracy-free environment;
• We adore change-makers and creators so you'll be able to influence our processes;
• Highly skilled project teams that consists of senior level professionals;
• Wise projects rotation including ML, Big Data, IoT, fintech and healthcare;
• Paid AWS certifications