As a Cloud Data Engineer, your role will be to build and support data infrastructure that enables our clients to make data-driven decisions. You will be expected to collect, transform, and automate data models, and work closely with our data science team to deploy and automate machine learning models.
Preferably you should be based in Spain or at least in the EU.
Tasks
- Maintaining in-depth knowledge of cloud-related technologies and can articulate best approaches and practices to the team
- Design, build, and maintain robust ETL/ELT pipelines, primarily leveraging tools like Dagster for orchestration and deploying them on our Kubernetes cluster, while also adapting to client-specific requirements and diverse data environments.
- Part of your work will be to automate and streamline some of the manual processes regarding data flows
- You will translate client needs and objectives into actionable development plans and strategies to help them reach their goals and be able to discuss the plans with them.
- In addition, we are in charge of developing and managing data transformation layers, primarily using DBT (data build tool) and, in some cases, Google Dataform.
- BA/BS degree in Computer Science, Mathematics, Economics, or a related technical field, or equivalent practical experience
- Proven experience as a Cloud Data Engineer, with a strong focus on Google Cloud Platform (GCP)
- Strong SQL knowledge and proficiency in Python
- Hands-on experience with Dagster for data orchestration, or comparable experience with other modern orchestration tools like Airflow.
- Familiarity with Kubernetes for deploying and managing data pipelines
- Knowledge of Relational and non-relational datasets
- Experience with DBT (data build tool) or Google Dataform for data transformations
- Experience automating manual processes
- Excellent analytical and problem-solving skills
- Significant experience in designing, developing, and troubleshooting large production-grade data systems on the Google Cloud and being able to select the appropriate tools to solve business problems
- Ability to advise customers as an expert in your area of expertise
- Google Certified Professional Data Engineer or other relevant GCP certifications
- Experience working with Google Analytics raw data exports to BigQuery and leveraging this data for analytical purposes.
- Knowledge of Vertex AI for machine learning operations
- Familiarity with other cloud providers (though GCP is preferred)
- Strong expertise in Terraform
- Experience with stream processing systems
- Experience with agile working practices and tools
- Co-Working - you have a place in the best co-working spaces in Düsseldorf, Zurich, Barcelona, or Hamburg at your disposal.
- Remote 1st - all our processes are designed for decentralized working. You decide whether you prefer to work in your home office or spend your day in one of our offices
- Home Office Equipment - we provide you with a standard for your remote working environment
- Animal Lovers - If you have a dog, you can bring it to any of our offices
- Skill Building - As a highly specialized technology partner, we support your development with certificates, conference attendance, and training
- Diverse and Specialized team - Allows team members to gain experience working with multiple cultures and empowers their personal strengths and goals
- Agile Work Environment - Agile working is becoming increasingly important in order to work and adapt in fast-paced environments. This allows the team at Digitl Cloud to work efficiently while benefitting from more flexibility and freedom.
Reportar empleo
