Data Architect with Pyspark

Data Architect with Pyspark

20 Jan 2024
Texas, Fortworth, 76101 Fortworth USA

Data Architect with Pyspark

Vacancy expired!

  • The big data and predictive analytics team is seeking an individual to standardize and automate open source processes and functions.
  • Primarily, this position will focus on automating quality assurance, testing, and provisioning processes.
  • Extended areas of concentration will be creating end user applications intended to expedite and automate data acquisition, integration, and control processes.

Duties/Responsibilities:
  • Responsible for identifying and designing automation opportunities
  • Build a working knowledge of all existing operational analytics and data pipeline methods and functionality
  • Create effective and automated processes to drive efficiency and consistency across all areas of big data and advanced analytics projects
  • Work closely with peers and leadership within Technology Services to develop an automation framework
  • Create an infrastructure to support continued growth in the open source environment

Basic Qualifications:
  • 8-10 Years of experience in SQL queries and working with NoSQL, RDBMS
  • Bachelor’s in Business, Information Technology, Computer Science, Economics or other related discipline or equivalent work-related experience
  • Apache Hadoop software library knowledge
  • Proficient with automation tools and framework design
  • Experience in automation scripting and web application development
  • Strong personal and organizational skills to execute project deliverables
  • Excellent verbal and written communication skills to lead a cross functional team

Preferred Qualifications:
  • MBA or equivalent degree
  • Working knowledge of Hortonworks 2.3 or greater
  • Experience in using Java, pySpark, Python, Scala, Spark, Shell script, Spark with Python, Spark streaming and SQL.
  • Background in ETL and data warehousing
  • Sqoop, Hive and Big data concepts.
  • Shell scripting
  • ADF, Azure databricks , ADLS is good to have

Related jobs

  • Business Title: Director, Event Monitoring and Optimization Architect

  • Everlight Solar is seeking a skilled Data Analyst who will design and maintain functional programs and applications, producing fully functional software applications according to requirements. As a Data Analyst, you play a key role in serving our clients and team members. This will be a full-time, work-from-home \"remote\" position.

  • Everlight Solar is seeking a skilled Data Analyst who will design and maintain functional programs and applications, producing fully functional software applications according to requirements. As a Data Analyst, you play a key role in serving our clients and team members. This will be a full-time, work-from-home \"remote\" position.

  • Everlight Solar is seeking a skilled, data-minded individual to be an assistant to our Solar Project Manager. Our project managers and assistants oversee and coordinate the entire process for company projects, assisting customers, team members, and contractors, ensuring that each project is completed in a timely manner with high-quality results. This will be a full-time, work-from-home \"remote\" position.

  • Are you interested in working in a dynamic environment that offers opportunities for professional growth and new responsibilities? Are you interested in helping clients drive alignment with their business, improve organizational and human resource performance and establish a culture focused on adding business value?

  • Everlight Solar is seeking a skilled Data Analyst who will design and maintain functional programs and applications, producing fully functional software applications according to requirements. As a Data Analyst, you play a key role in serving our clients and team members. This will be a full-time, work-from-home \"remote\" position.

Job Details

  • ID
    JC8379529
  • State
  • City
  • Job type
    Permanent
  • Salary
    Depends on Experience
  • Hiring Company
    Tech Mahindra (Americas) Inc.
  • Date
    2021-01-11
  • Deadline
    2021-03-12
  • Category

Jocancy Online Job Portal by jobSearchi.