Remote Data Engineer needs 10 years experience
Remote Data Engineer requires:
Must be local top Santa Clara
Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically:
BigQuery: Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.
Experience with other relevant GCP services like Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub
Programming & Querying:
Python: Expert-level programming proficiency in Python, including experience with relevant data engineering libraries
SQL: A solid command of advanced SQL for complex querying, data processing, and performance tuning.
Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Airflow,Dagster, or similar).
DevOps/CI/CD: Experience with version control (Git) and familiarity with CI/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes.
DevOps/CI/CD, Data Pipeline Orchestration:, SQL, Cloud Platform Expertise (GCP Focus):, Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub
Remote Data Engineer duties:
Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development.
Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics
Implement and support Big Data solutions for both batch (scheduled) and real-time/streaming analytics.
Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.
...NVIDIA has been redefining computer graphics, PC gaming, and accelerated computing for more than 25 years. Its a unique legacy of innovation thats fueled by great technologyand amazing people! Today, were tapping into the unlimited potential of AI to define the next...
...Job Description PRIDE Health is seeking a travel Registered Respiratory Therapist for a travel job in Delta, Colorado. Job Description & Requirements ~ Specialty: Registered Respiratory Therapist ~ Discipline: Allied Health Professional ~ Start Date: 11/0...
...A prominent think tank in Washington, DC is seeking a Managing Director for Strategy Implementation. This role focuses on designing organizational functions to enhance strategic execution and transformation across the institution. The successful candidate will lead performance...
...livello Middle , con almeno 3 anni di esperienza nella gestione e analisi dei dati, e una solida padronanza di Azure Data Factory e Power BI . La figura si occuper della trasformazione dei dati, della creazione di pipeline di integrazione, e dello sviluppo di report...
...in many ways, and we are looking for others who would like to experience the same. We value the benefits of work/life balance... ...cutting-edge technology. Were looking for a mid-level Full Stack Web Developer to join our talented team. You will work on exciting...