Description: GCP Big Query Data Engineer 7+ Years of Experience preferredExperience in creating ETL pipeline using dataflow & Bigquery, Experience to create best performing tables with partitioning/clustering etc enabled keeping best practices in mindWrite Complex SQL queries keeping execution cost in mind.Hands-on with DAG using YAML or Airflow (Python)Knowledge of Cloud ComposerLoad data into BigQuery using files or by streaming one record at a time .Create, load, and query partitioned tables for daily batch processing data.Implement fine-grained access control using roles and authorized views.Should have in-depth understanding of Bigquery architecture, table partitioning, clustering, best practices.Should know how to reduce BigQuery costs by reducing the amount of data processed by your queries.Should be able to speed up queries by using denormalized data structures, with or without nested repeated fields.Exploring and Preparing data using BigQuery.Implementing ETL jobs using Bigquery.VIVA is an equal opportunity employer. All qualified applicants have an equal opportunity for placement, and all employees have an equal opportunity to develop on the job. This means that VIVA will not discriminate against any employee or qualified applicant on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status
Description:
GCP Big Query Data Engineer
(Please ensure email matches your resume email)
(document types allowed: doc/docx/rtf/pdf/txt) (max 2MB)
By submitting this form, you are consenting to the VIVA team contacting you via Phone/Email