Technical Lead -Data Engineer
ProArch.com
Office
Hyderabad, Telangana, India
Full Time
About Proarch:
Founded in 2006, ProArch began as a tight-knit team of business-minded IT professionals passionate about delivering exceptional cloud-based technology solutions. Today, we’ve grown into a global force spread across US, UK and India into multidisciplinary experts spanning cloud, infrastructure, data analytics, cybersecurity, compliance, and software development. Organizations turn to ProArch for forward-thinking guidance, seamless implementation, and dependable ongoing support partnering with us to reach every milestone on the path to their vision.
Our services consist of specific practice areas that are methodically designed to complement and enhance each other's effectiveness. This interconnected approach removes roadblocks and drives rapid growth and financial stability. Many of our clients leverage the full scope of our services, creating a supply chain of value that impacts the entire organization from IT to customer experience.
At our core, we believe in the power of technology to transform. We’re passionate about inspiring innovation that shapes our people, our clients, our partners, and the communities we serve.
About Role:
We are seeking a highly skilled and visionary Data Engineer – Technical Lead to join our growing data engineering team. This role is ideal for someone who thrives on architecting scalable data solutions, leading high-impact projects, and mentoring a team of talented engineers. You will be instrumental in designing and implementing robust data architectures and ETL pipelines across Azure and AWS platforms to support our analytics, machine learning, and business intelligence initiatives.
Key Responsibilities:
- Lead Data Architecture Design: Define and implement scalable, secure, and high-performance data architectures across cloud platforms (Azure and AWS).
- Build & Optimize ETL Pipelines: Design, develop, and maintain robust ETL/ELT workflows for structured and unstructured data using tools like Azure Data Factory, AWS Glue, Apache Spark, and Databricks.
- Data Modeling: Create logical and physical data models that support business intelligence, analytics, and operational reporting.
- Cloud Data Engineering: Leverage cloud-native services (e.g., Azure Synapse, AWS Redshift, S3, Lambda, EMR) to build modern data platforms.
- Technical Leadership: Mentor junior engineers, conduct code reviews, and enforce best practices in data engineering and DevOps.
- Performance Tuning: Optimize data storage, retrieval, and processing for performance and cost-efficiency.
- Data Governance & Security: Implement data quality, lineage, and security standards in compliance with organizational and regulatory requirements.
- Cross-Functional Collaboration: Work closely with data scientists, analysts, product managers, and business stakeholders to translate data needs into technical solutions.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in data engineering with at least 2 years in a technical leadership role.
- Proven expertise in data modeling (3NF, dimensional, data vault) and data architecture.
- Strong hands-on experience with Azure (Data Factory, Synapse, ADLS) and AWS (Glue, Redshift, S3, Lambda).
- Proficiency in SQL, Python, and Spark.
- Experience with CI/CD, infrastructure as code (Terraform, CloudFormation), and data orchestration tools (Airflow, Prefect).
- Familiarity with data governance, cataloging, and lineage tools (e.g., Purview, Collibra, Alation).
Preferred Qualifications
- Experience with real-time data processing (Kafka, Kinesis, Azure Event Hubs).
- Knowledge of data lakehouse architectures and Delta Lake.
- Certifications in Azure or AWS data engineering tracks.
- Exposure to machine learning pipelines and MLOps is a plus.
Life @ Proarch
- At ProArch, we believe our people are the key to our success. That’s why we foster an environment where every employee—known proudly as a ProArchian—can grow, thrive, and make a meaningful impact.
- We empower employees to develop at their own pace through Career Pathways, a clear and supportive guide to professional progression.
- Our culture is one of positivity, inclusivity, and respect. Titles don’t define how we treat each other—every ProArchian is valued equally, and collaboration across roles and teams is the norm.
- We understand that great work starts with balance. That’s why we prioritize work-life harmony, offering flexible work schedules and encouraging time for what matters most.
- Beyond the workplace, ProArchians actively give back—organizing volunteer efforts and charitable initiatives that empower the communities we call home.
- And because we know that extraordinary efforts deserve recognition, we celebrate those who go above and beyond with appreciation programs.
- At ProArch, we’re not just using technology to transform businesses—we’re using it to create a better experience for our people, our clients, and our communities.
Competencies:
- Excellent Communication
- Analytical Skills
- Negotiation Skills
- Problem Solving Skills
- Client Engagement
- Relationship Building