Intermediate Data Engineer
Job Summary:
We are looking for an Intermediate Data Engineer to help develop and maintain our data platforms
Required Skill-set:
- A background in Computer Science, Computer Engineering, or Data Science
- At least 3-5 years of experience in IT, with a minimum of 2 years of experience in data engineering
- Advanced working knowledge of programming languages such as SQL and Python
- Proficient in ETL/ELT pipeline development, testing, and deployment
- Experience in data model designing such as Star Schema or Snowflake
- Familiarity with cloud-based data warehousing such as AWS Redshift, Teradata,
- Oracle Exacdata Machine, or Cloudera Enterprise Data Hub
- Familiarity with big data streaming tools and database frameworks such as Apache NiFi, Storm, Spark, Hadoop, Tableau
- Good writing, communication, and presentation skills 10.Fast learner and ability to work independently
Responsibilities:
- Design, develop, document, and implement end-to-end data pipelines
- Perform data analysis, data profiling, data cleansing, data lineage, data mapping, and data transformation
- Develop ETL/ELT jobs and workflows and deployment of data solutions
- Monitor, recommend, and implement ways to improve data quality, including reliability, efficiency, and cleanliness, to optimize and fine-tune processes.
- Collaborate with cross-functional teams to design and develop data solutions that meet business needs
- Deliver projects on time and with quality.
Job Type: Full Time