Job Overview
We are seeking a skilled Data Engineer to join our team and drive our data infrastructure forward. In this role, you will primarily focus on maintaining and enhancing our data warehouse and pipelines (80%) while also contributing to data analysis and reporting initiatives (20%). You'll work closely with cross-functional stakeholders to build robust data solutions and create actionable insights through compelling visualizations.
Key Responsibilities
Data Engineering
- Infrastructure Management: Maintain, enhance, and optimize existing data warehouse architecture and ETL pipelines.
- Pipeline Development: Design and implement scalable ETL/ELT processes ensuring data quality, integrity, and timeliness.
- Performance Optimization: Monitor and improve pipeline performance, troubleshoot issues, and implement best practices.
- Documentation: Create and maintain comprehensive documentation for data engineering processes, architecture, and configurations.
Data Analysis & Reporting
- Stakeholder Collaboration: Partner with business teams to gather requirements and translate them into technical solutions.
- Report Development: Build and maintain PowerBI dashboards and reports that drive business decisions.
- Data Modeling: Develop new data models and enhance existing ones to support advanced analytics.
- Insight Communication: Transform complex data findings into clear, actionable insights for various departments.
Required Qualifications
Technical Skills
- Programming & Query Languages: Strong proficiency in Python, SQL, and PySpark.
- Big Data Platforms: Experience with cloud data platforms including Snowflake, BigQuery, and Databricks. Databricks experience highly preferred.
- Orchestration Tools: Proven experience with workflow orchestration tools (Airflow preferred).
- Cloud Platforms: Experience with AWS (preferred), Azure, or Google Cloud Platform.
- Data Visualization: Proficiency in PowerBI (preferred) or Tableau.
- Database Systems: Familiarity with relational database management systems (RDBMS).
Development Practices
- Version Control: Proficient with Git for code management and collaboration.
- CI/CD: Hands-on experience implementing and maintaining continuous integration/deployment pipelines.
- Documentation: Strong ability to create clear technical documentation.
Experience & Communication
- Professional Experience: 3+ years in data engineering or closely related roles.
- Language Requirements: Fluent English communication skills for effective collaboration with U.S. based team members.
- Pipeline Expertise: Demonstrated experience building and maintaining production data pipelinesk
...components. We are seeking a motivated and detail-oriented Human Resources Intern to support our HR team in various functions related... ..., employee relations, and HR operations. This paid internship offers an excellent opportunity for individuals interested in...
OverviewJoin to apply for the Power Plant Operator (NO HVAC) role at Memorial Hospital Belleville and Memorial Hospital ShilohBase pay range: $20.17/hr - $33.51/hrThis range is provided by Memorial Hospital Belleville and Memorial Hospital Shiloh. Your actual pay...
...Job Title: Industrial Safety Manager Location: On Site - Greater Atlanta, Georgia, United States Salary: $100,000-$140,000 Skills: Electrical Safety, OSHA, Airport Construction, Commercial Construction, Incident Investigation About the Construction Company...
...HUB International Job Post At HUB International, we are a team of entrepreneurs. We believe in empowering our clients by protecting businesses... ...teams to maintain their own unique, regional culture. The Courier is responsible for supporting the Office Support Manager/...
...reliable sitter to care for our newborn.We are offering $7.25 an hour for the right fit. We are seeking someone with experience in... ...for our baby.We are looking for someone who is willing to work flexible hours and is available to travel. If this sounds like an opportunity...