Sr. Data Engineer
Full-Time @Algae Services posted 1 day ago Shortlist Email JobJob Detail
-
Job ID 58409
Job Description
Job Summary
Algae services is looking for an experienced Senior Data Engineer to develop, manage, and
optimize data systems and solutions. This role involves working across the entire data
lifecycle, from ingestion to analytics, ensuring scalable and high-performing solutions.
You will collaborate closely with our engineering team to design, develop, and maintain
Snowflake-based data architectures while ensuring data integrity and system efficiency.
Key Responsibilities
• Design, develop, and manage data solutions in an enterprise environment.
• Lead the development and optimization of data pipelines and data models within
Snowflake.
• Work with Python and SQL to build scalable data processing solutions.
• Design and implement data warehouses in Snowflake, ensuring efficient data
organization and retrieval.
• Develop production-ready data ingestion and processing pipelines using Spark,
Scala, and Python.
• Implement and manage orchestration tools such as Airflow, Informatica, or
Automic.
• Ensure data governance, metadata management, and data lineage tracking.
• Utilize SQL analytical functions to support advanced data analytics.
• Develop scripts using Shell scripting and JavaScript for automation and
optimization.
• Follow CI/CD, automated testing, and performance engineering best practices.
• Work with Git, Confluence, and Jira for version control, documentation, and
project tracking.
• Troubleshoot and resolve data-related issues, ensuring system reliability and
efficiency.
• Collaborate with cross-functional teams, including data scientists, analysts, and
business stakeholders.
Required Qualifications & Experience
• 8+ years of experience in designing and developing enterprise data solutions.
• 3+ years of hands-on experience with Snowflake.
• 3+ years of experience in Python development.
• Strong expertise in SQL and Python for data processing and transformation.
• Experience with Spark, Scala, and Python in production environments.
• Hands-on experience with data orchestration tools (e.g., Airflow, Informatica,
Automic).
• Knowledge of metadata management and data lineage.
• Strong problem-solving skills with an ability to work in a fast-paced, agile
environment.
• Excellent communication and collaboration skills.
Required skills
Other jobs you may like
-
DV360 Programmatic Specialist
- @ LTI Mindtree
- Hyderabad, Telangana, India