Key responsibilities:
Design, build, and maintain data pipelines that enable the extraction, transformation, and loading (ETL) of data from various sources into Snowflake data warehouses.
Utilize AWS services such as S3, Glue, EC2, Lambda, and others to manage data storage, processing, and automation.
Administer and optimize the Snowflake data warehouse environment, including managing data warehouses, roles, and access controls.
Create and manage infrastructure as code (IAC) using Terraform to automate and maintain AWS and Snowflake resources.
Develop and maintain integrations between data sources, ensuring data consistency and accuracy.
Work within an agile development framework, collaborating with cross-functional teams to deliver data solutions that meet the evolving needs of the organization.
Use Jira for task tracking and project management.
Implement data quality checks and validation processes to ensure data integrity and reliability.
Maintain detailed documentation of data engineering processes and solutions.
Required Skills:
8+ years proven experience in data engineering and architecture, including ETL processes, data pipelines, and data warehouse modeling.
Experience using Github for CI/CD pipeline
Experience with using Airflow for scheduling and monitoring data workflows
Expertise in AWS services, particularly for data and analytics, and experience with Snowflake data warehousing.
Agile Methodology: Experience working in an agile development environment and using Jira for task management.
Strong problem-solving skills and the ability to work with large datasets.
Strong communication skills and the ability to collaborate with cross-functional teams.
A commitment to data accuracy, quality, and security.
Experience with data integration tools and practices is a plus.
Good to have skills:
Master’s degree in Computer Science, Engineering or related field is preferred
Proficiency in infrastructure as code (IAC) using Terraform for AWS and Snowflake is a big plus
Experience with CI/CD data infrastructure build-up
Experience in banking, financial services, credit card, fintech in a start-up environment
OMNISTAR EEO:
The equal employment opportunity policy of the OMNISTAR Solutions LLC., provides for a fair and equal employment opportunity for all associates and job applicants regardless of race, color, religious creed, national origin, ancestry, age, gender, pregnancy, sexual orientation, gender identity, marital status, familial status, disability or genetic information, in compliance with applicable federal, state and local law. OMNISTAR Solutions LLC., hires and promotes individuals solely on the basis of their qualifications for the job to be filled.
OMNISTAR Solutions LLC. does not tolerate an atmosphere of intimidation or harassment. We expect and require the cooperation of all associates in maintaining an atmosphere free from discrimination and harassment with mutual respect by and for all associates and applicants.
