This job was posted more than 40 days ago and might be expired.
3Pillar logo

Senior Data Engineer (Snowflake & Python)

Posted about 2 months ago

OfficeIndia
๐ŸŒŸ Distinguished Tech Innovator:3Pillar warmly extends an invitation for you to join an elite team of visionaries. Beyond software development, we are dedicated to engineering solutions that challenge conventional norms. Envision you: steering projects that redefine urban living, establish new media channels for enterprise companies, or drive innovation in healthcare. Your invaluable expertise will serve as the cornerstone in shaping the future direction of our endeavors.This role transcends the ordinary realms of coding; it's about orchestrating technological marvels that disrupt industries. Seize this extraordinary opportunity to lead a team that is actively shaping the tech landscape for our clients, and sets global standards along the way. ๐ŸŒ๐Ÿ”ฅ
### Minimum Qualification
  • Experience: 5-10 years of experience in data engineering,
  • Strong exp in Snowflake.
  • Programming & Scripting: Strong programming skills in Python and Linux Bash for automation and data workflows.
  • Framework Proficiency: Hands-on experience with Luigi for orchestrating complex data workflows.
  • Data Processing & Storage: Expertise in Hadoop ecosystem tools and managing SQL databases for data storage and query optimization.
  • AWS Cloud Services: In-depth knowledge of AWS EC2, S3, RDS, and EMR to deploy and manage data solutions.
  • Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
  • Communication & Leadership: Proven ability to lead projects, communicate with stakeholders, and guide junior team members.
  • ### Additional experience
  • Data Architecture: Experience designing or optimizing data lake solutions.
  • Security Practices: Understanding of data security practices, data governance, and compliance for secure data processing.
  • Automation & CI/CD: Familiarity with CI/CD tools to support automation of deployment and testing.
  • Big Data Technologies: Knowledge of big data processing tools like Spark, Hive, or related AWS services.
  • Advanced Analytics: Background in analytics or data science to contribute to more data-driven decision-making.
  • Cross-Functional Collaboration: Experience collaborating with non-technical teams on business goals and technical solutions.
  • Job details
    Workplace
    Office
    Location
    India

    3Pillar is a leading modern application strategy, design, and engineering firm. Our expertise in product engineering and intelligent computing helps clients execute strategic software development initiatives.

    Key team members

    Jeremy Chan

    Jeremy Chan

    Scott Bleasdell

    Scott Bleasdell

    Sean Morgan

    Sean Morgan

    Michael Detwiler

    Michael Detwiler

    Apply smarter with Jobr

    Jobr aggregates jobs directly from company career portals โ€” no middlemen. Our team applies on your behalf with AI-tailored resumes, reviewed by a human before submission.

    Direct from company career pages
    AI-personalised cover letters
    Human review before every submit
    Application tracking & follow-ups