The Opportunity
We’re looking for a skilled Data Engineer to architect robust data pipelines and infrastructure that will propel Digitaly India’s growth and innovation. You’ll be instrumental in designing, building, and optimizing our data systems to handle large-scale, real-time data processing.
Key Responsibilities
- Data Architecture: Design and develop scalable data pipelines, ETL processes, and data warehouses to ensure efficient data collection, storage, and accessibility.
- Data Transformation: Clean, transform, and enrich raw data using SQL and programming languages like Python or Scala.
- Big Data Technologies: Expertise in working with Hadoop, Spark, NoSQL databases (e.g., MongoDB, Cassandra), and cloud-based data platforms (e.g., AWS, Azure).
- Data Modeling: Build and maintain data models that address complex business requirements.
- Performance Optimization: Analyze and improve the performance of data systems ensuring optimal efficiency and scalability.
- Collaboration: Work closely with data scientists, analysts, and stakeholders to understand requirements and deliver impactful data solutions.
Qualifications
- Education: Bachelor’s degree in Computer Science, Engineering, or a related field.
- Experience: [2-4+] years of experience as a Data Engineer with a proven track record of building and managing data infrastructure.
- Technical Skills: In-depth proficiency in:
- SQL and database technologies (relational and non-relational)
- Python, Scala, or a similar language for data manipulation
- Big data frameworks (Hadoop, Spark)
- Cloud computing platforms (AWS, Azure, GCP)
- Analytical Mindset: Strong problem-solving skills and the ability to understand complex data structures.
- Communication: Excellent communication skills, both written and verbal, for technical and non-technical audiences.
Nice to Have
- Experience with machine learning pipelines and data visualization tools (Tableau, Power BI)
Benefits
- Competitive Salary: Be rewarded for your expertise and contributions.
- Learning & Growth: Develop your skills in a cutting-edge environment with exposure to innovative data projects.
- Dynamic Team: Collaborate with a diverse team of talented data professionals and industry leaders.
- Impactful Work: Shape the future of data-driven decision-making at Digitaly India.