|
100% onsite M-F in Statesboro GA or Savannah GA Think is seeking a Data Engineer II to join their client in Statesboro GA to focus on designs, develops, maintains and optimizes the data infrastructure for our data lake and data warehouses to support enterprise business intelligence and data-informed decision making. Responsible for building and optimizing scalable data pipelines and systems for data integration, processing, and storage; ELT/ETL processes and data dashboards. This role involves integrating data from various applications and managing data lake processes. The engineer also provides support for business report writing and automation, ensuring data integrity and optimizing database performance. Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines for ingesting, transforming, and loading structured and unstructured data from diverse sources
- Build and manage robust ETL/ELT processes to ensure data quality, integrity, and availability
- Monitor and optimize the performance of data pipelines and database systems, identifying and resolving bottlenecks
- Create and maintain comprehensive documentation for data architectures, pipelines, and processes
- Implement and manage data models to support analytics and reporting needs
- Integrate data sources into platforms such as Snowflake, Power BI, or Tableau
- Implement data quality checks, monitoring, and anomaly detection to ensure the reliability of data used for model development and deployment. Contribute to data governance best practices
- Identify and mitigate data security and privacy risks
- Keep abreast of new technologies and best practices in data engineering, big data, and machine learning operations
Required Qualifications
- Bachelor's Degree in Computer Science, Information Systems, or other appropriate degree
- Five or more years of related work experience in data engineering, including data pipeline development
- and optimization, ETL/ELT processes, and data integration
- Proficiency with at least one of the following programming or query languages: SQL, Python, Java, R
Preferred Qualifications
- Experience with Snowflake and Microsoft Power BI
Equal Opportunity Employer, including disability and protected veteran status
|