Big Data Engineer
Job Description
Build dependable large-scale data pipelines and explain their architecture, performance and quality controls.
What you will do
• Design and maintain distributed data pipelines and storage architectures.
• Use Python for integration, transformation, processing and automation.
• Optimize relational and NoSQL storage and monitor availability and performance.
• Diagnose failures and apply data-quality, security and governance standards.
• Document models, ETL processes and technical decisions clearly.
Required background
• Hands-on experience engineering large data pipelines.
• Advanced Python and strong relational/NoSQL database skills.
• Distributed-processing experience with technologies such as Hadoop, Spark or Flink.
• Solid data modeling, warehousing and ETL knowledge, with clear communication and independent problem-solving.
Preferred background
• Cloud data platforms on AWS, Azure or GCP.
• Experience supporting distributed teams or fast-moving organizations.
• Familiarity with MLOps and data-science workflows.
Location and eligibility
• Remote work; country restrictions are not stated.
Availability
• Hours and duration are agreed before work; no fixed commitment is stated.
Pay and engagement
$32 • $84/hr
USD hourly compensation. The applicable rate and agreed work scope are confirmed before work begins.