Google Cloud Platform Data Solution Architect (W2 ONLY)

Google Cloud Platform Data Solution Architect (W2 ONLY)

Posted Today by SumasEdge Corporation

Apply
Negotiable
Undetermined
Remote
Remote
Apply
Airflow Angular (Web Framework) Apache Airflow Apache Beam Application Programming Interface (API) Automation AWS Identity And Access Management (IAM) Change Data Capture (CDC) Cloud Computing Cloud Infrastructure Cloud Services Cloud Storage Cloud Technology Continuous Integration and Continuous Delivery Database Design Dataflow Data Ingestion DevOps Docker (Software) Dockerfile Domain Name System (DNS) Servers Generic Programming Google Cloud Google Cloud Platform (GCP) Infrastructure as Code (IaC) Java (Programming Language) Jenkins Management Python (Programming Language) Scalability Service Accounts Single Sign-On (SSO) Software Development Stackdriver Terraform

Summary: The role of Google Cloud Platform Data Solution Architect involves enhancing and managing data ingestion pipelines using Google Cloud services, particularly focusing on Composer and Airflow. The position requires a strong understanding of cloud infrastructure, database design, and API development, along with collaboration with DevOps teams for CI/CD management. Proficiency in programming languages such as Java or Python is essential, along with excellent problem-solving and communication skills.

Key Responsibilities:

  • Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming).
  • Have Good Understanding of Google Cloud Platform Composer (Apache Airflow) environments.
  • Manage Airflow DAGs and troubleshoot Airflow-related issues.
  • Monitor and optimize Composer performance and scalability.
  • Maintain Google Cloud Platform infrastructure including services like:
    • Google Cloud Storage (GCS)
    • BigQuery (BQ)
    • Cloud Dataflow (Apache Beam)
    • Cloud Dataproc
    • Cloud Functions
    • Cloud Run
  • Have Good Understanding of:
    • IAM and service account permissions
    • Secret Manager
  • Monitor Google Cloud Platform usage and quotas, and proactively prevent quota-related issues.
  • Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
  • DB design experience (with Excellent RDBS-PLSQL knowledge).
  • Design Springboot APIs.
  • Analyze, design, create Dockerfile.
  • Knowledge on Angular (Good to Have).
  • Design and implement infrastructure as code using Terraform for provisioning and managing Google Cloud Platform resources.
  • Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
  • Ensure security, compliance, and cost-efficiency across the cloud environment.
  • Document system configurations, procedures, and best practices.
  • Proficient in either Java or Python programming languages.
  • Excellent problem-solving and troubleshooting skills.
  • Strong communication and documentation abilities.
  • Knowledge on DNS and SSO configuration setup.
  • Knowledge on CDC Pipelines/Application (Good to Have).

Key Skills:

  • Google Cloud Platform expertise, particularly with Composer and Airflow.
  • Database design and RDBS-PLSQL knowledge.
  • Proficiency in Java or Python programming languages.
  • Experience with Docker and Terraform.
  • Understanding of IAM, service accounts, and Secret Manager.
  • Knowledge of CI/CD processes and tools like Jenkins.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and documentation abilities.
  • Familiarity with DNS and SSO configuration.
  • Knowledge of Angular and CDC Pipelines (Good to Have).

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Job Description

  • Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .
  • Have Good Understanding of Google Cloud Platform Composer (Apache Airflow) environments.
  • Manage Airflow DAGs and troubleshoot Airflow-related issues.
  • Monitor and optimize Composer performance and scalability.
  • Maintain Google Cloud Platform infrastructure including services like:
    • Google Cloud Storage (GCS)
    • BigQuery (BQ)
    • Cloud Dataflow ( Apache Beam )
    • Cloud Dataproc
    • Cloud Functions
    • Cloud Run
  • Have Good Understanding of:
    • IAM and service account permissions
    • Secret Manager
  • Monitor Google Cloud Platform usage and quotas, and proactively prevent quota-related issues.
  • Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
  • DB design experience (with Excellent RDBS-PLSQL knowledge )
  • Design Springboot APIs
  • Analyze, design, create Dockerfile
  • Knowledge on Angular ( Good to Have )
  • Design and implement infrastructure as code using Terraform for provisioning and managing Google Cloud Platform resources.
  • Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
  • Ensure security, compliance, and cost-efficiency across the cloud environment.
  • Document system configurations, procedures, and best practices.
  • Proficient in either Java or Python programming languages.
  • Excellent problem-solving and troubleshooting skills.
  • Strong communication and documentation abilities.
  • Knowledge on DNS and SSO configuration setup
  • Knowledge on CDC Pipelines/Application (Good to Have)
Apply
Similar Jobs
Loading data...