Job Board
View all jobs

Databricks Admin at Peer Consulting Resources Inc. Santa Clara, CA

P

Peer Consulting Resources Inc.

Santa Clara, CA, US

9 days ago
full-time
No degree mentioned

Job highlights

Qualification

Years Of Experience: 10-12 Yrs. Overall Exp: - 6+ Years. Relevant exp: - 3+ Years. We are looking for a Databricks Administrator with Cloud Administration expertise inside and out. The candidate must be an expert in Docker and Cloud based containerization technologies. Operations or systems administration experience, particularly on Linux. Hands-on administration experience, from setting up the Databricks environment to successfully. Experience as Databricks workspace admin, managing workspace users and groups including single. sign-on, provisioning, access control, and workspace storage. Experience Databricks administration configuring and installing libraries. Experience managing storage accounts access across a large user base. Experience managing cluster and jobs, policies, templates, pools configuration options. Experience with Databricks security and privacy setup. Experience troubleshooting end user and platform-level issues. Experience in strategizing and implementing Disaster recovery for BigData platforms based on Databricks. Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders. Strong coding skills in SQL and Python (PySpark) with experience optimizing code

Responsibility

The candidate will work on building, scaling, and monitoring highly complex BigData platform on Databricks, Snowflake DB and ElasticSearch cloud. The candidate will work on building, scaling, and monitoring Data science and ML hosting platform based on Databricks. The candidate will be responsible for defining and implementing our Data platform, Data science workbench with ML hosting technology strategies in the Cloud. The candidate will also be involved in designing our architecture and defining our roadmap. The candidate will be responsible to implement monitoring, alerting and observability solutions using CSP standard monitoring and analytical tools and 3 rd party tools like Zabbix and Datadog SaaS. The candidate will also be responsible for building and improving our CI/CD pipelines and keepingnthemselves and their team up to date with the latest industry trends and technologies. Develop automation scripts in Terraform, YAML, Helm charts, az cli, aws-cli, Powershell and other cloud APIs. Participate in developer interaction calls and help. Participate in Management update calls and provide precise, timely updates. administering it. Experience as the Databricks account owner, managing workspaces, Unity Catalog, audit logs, and. high-level usage monitoring. Work with n/w team to create PEs, troubleshoot network issues etc

Job Description

Description

Databricks Admin job at Peer Consulting Resources Inc.. Santa Clara, CA. Job Title: Databricks AdminLocation:Santa Clara, CA (Need Locals) Duration:12 Months+ Years Of Experience: 10-12 Yrs Notes: • Interview process: Phone screen followed by mandatory in-person interview 5 days on-site role. • Need locals Job Description: - Databricks Administrator with Cloud Administration expertise Overall Exp: - 6+ Years Relevant exp: - 3+ Years We are looking for a Databricks Administrator with Cloud Administration expertise inside and out. Responsibilities The candidate will work on building, scaling, and monitoring highly complex BigData platform on Databricks, Snowflake DB and ElasticSearch cloud. The candidate will work on building, scaling, and monitoring Data science and ML hosting platform based on Databricks. The candidate will be responsible for defining and implementing our Data platform, Data science workbench with ML hosting technology strategies in the Cloud. The candidate will also be involved in designing our architecture and defining our roadmap. The candidate will be responsible to implement monitoring, alerting and observability solutions using CSP standard monitoring and analytical tools and 3 rd party tools like Zabbix and Datadog SaaS. The candidate must be an expert in Docker and Cloud based containerization technologies. The candidate will also be responsible for building and improving our CI/CD pipelines and keepingnthemselves and their team up to date with the latest industry trends and technologies. Develop automation scripts in Terraform, YAML, Helm charts, az cli, aws-cli, Powershell and other cloud APIs. Participate in developer interaction calls and help. Participate in Management update calls and provide precise, timely updates. Skillset: Operations or systems administration experience, particularly on Linux. Hands-on administration experience, from setting up the Databricks environment to successfully administering it. Experience as the Databricks account owner, managing workspaces, Unity Catalog, audit logs, and high-level usage monitoring. Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage. Experience Databricks administration configuring and installing libraries. Experience managing storage accounts access across a large user base. Experience managing cluster and jobs, policies, templates, pools configuration options. Experience with Databricks security and privacy setup Experience troubleshooting end user and platform-level issues. Experience optimizing usage for performance and cost preferred. Experience in strategizing and implementing Disaster recovery for BigData platforms based on Databricks. Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders. Strong coding skills in SQL and Python (PySpark) with experience optimizing code. Assist in N/W, Data security, IAM initiatives. Work with n/w team to create PEs, troubleshoot network issues etc.