Browse more jobs

Data Engineer Job

Actively hiring

Data Engineer

Renan Partners

Bangalore

Start date

Starts Immediately

CTC (ANNUAL)

₹ 10,00,000 - 12,00,000 ₹ 10,00,000 - 12,00,000 /year

Experience

1 year(s)

1 year(s) experience

Apply By

12 Apr' 25

Posted few hours ago

Job

39 applicants

About the job

Key responsibilities:

1. Design, develop, and maintain ETL/ELT pipelines to process large volumes of data efficiently
2. Work with SQL and NoSQL databases to ensure optimized data storage and retrieval
3. Develop and maintain data lakes and data warehouses using cloud-based solutions (AWS, GCP, Azure)
4. Ensure data quality, integrity, and governance by implementing best practices for data validation and monitoring
5. Optimize data workflows and performance tuning to enhance query speed and system efficiency
6. Collaborate with cross-functional teams to integrate data solutions into various applications and services
7. Implement real-time and batch processing using tools like Apache Spark, Kafka, or Flink
8. Work with cloud-based data services (BigQuery, Redshift, Snowflake) for scalable and cost-effective solutions
9. Automate data pipeline deployment using CI/CD and infrastructure-as-code tools
10. Monitor and troubleshoot data pipeline issues, ensuring minimal downtime

Earn certifications in these skills

Learn Python

Learn Voice App Development

Learn SQL

Skill(s) required

Amazon Web Services (AWS) Docker Google Cloud Computing Kubernetes Python SQL

Earn certifications in these skills

Learn Python

Learn Voice App Development

Learn SQL

Who can apply

1. Candidates with minimum 1 years of experience.

Other requirements

1. 1-3+ years of experience in data engineering, data architecture, or a related field

2. Strong proficiency in Python, SQL, and scripting for data processing

3. Experience with big data processing frameworks such as Apache Spark, Hadoop, or Flink

4. Hands-on experience with ETL tools like Apache Airflow, DBT, or Talend

5. Knowledge of cloud platforms (AWS, GCP, or Azure) and their data services (Redshift, BigQuery, Snowflake, etc.)

6. Familiarity with data modeling techniques, database indexing, and query optimization

7. Understanding of real-time data streaming using Kafka, Kinesis, or Pub/Sub

8. Experience with Docker and Kubernetes for deploying data pipelines

9. Strong problem-solving and analytical skills, with a focus on performance optimization

10. Knowledge of data security, governance, and compliance best practices

Salary

Annual CTC: ₹ 10,00,000 - 12,00,000 /year

Perks

Informal dress code 5 days a week

Number of openings

About Renan Partners

Renan is an AI consultancy organization that offers data annotation and LLM fine-tuning services across over 50 languages.

Activity on Internshala

Hiring since August 2024

34 opportunities posted

39 candidates hired