Big Data Engineer; Must have 12+ Years of Experience

Big Data Engineer; Must have 12+ Years of Experience

14 Jun 2024
Texas, Dallas / fort worth, 75201 Dallas / fort worth USA

Big Data Engineer; Must have 12+ Years of Experience

Vacancy expired!

Intellisoft Technologies is a leading global information technology firm that specializes in Big Data & AI serving fortune 500 clients for past 21years. Company has been globally recognized for its comprehensive portfolio of services, innovation in technology and strong commitment to sustainability, governed by technocrats with industry experience.

At IntelliSoft, our professional development team helps your career by identifying right opportunities and guide you to acquire latest technologies in this fast paced technology world. We believe in our employees and provide them excellent benefits.

Must have 12+ Years of Experience

Job Title : Big Data Engineer /

Cloud Data Engineer

Location: Dallas, TX (Local Preferred)

Duration: 12 Months

Direct Client

Job Description:
Client is looking for an experienced

Big Data Engineer to build an analytics platform to collect, store, process, and analyze huge sets of data spread across the organization. The platform will provide frameworks for quickly rolling out new data analysis for data-driven products and micro-services.

Data Engineer will work with Data engineers to design, develop and maintain the data within the data lake, including setting the ETL (extract, transform, load) processes, bringing in new data sources, modifying existing data sources, making sure data is clean, complete, and consumable, as well as designing data models within the data lake and data warehouses. You will be writing high-quality code that is consistent with our standards, creating new standards as necessary, and demonstrating correctness with pragmatic automated tests.

Responsibilities:
Design and support the new and evolving sources of data being brought into the data lake.
Work closely with cloud architects and follow best practices for data management consumption.
Work closely with business analysts to work through business requirements and develop processes to provide the needed data visibility via the data warehouse and reporting platform.
Assist with application layer and metadata design.
Assist with the design and create automated applications and reporting solutions.

Preferred Qualifications:
Exposure to AWS Analytical Components like EMR, S3, EC2, Lambdas, DynamoDB, Redshift, RDS etc.
Work Experience with industry standard distributed systems (ie. Spark, hive), data pipeline tools (ie. Airflow), NoSQL Databases (DynamoDB) and databases (PostgreSQL).
Capable of quickly building expertise on an as-need basis on a new tech stack.
Significant experience optimizing data retrieval processes supporting API output, ideally within a low query volume / high data volume environment.
Demonstrably deep experience with Python.
Demonstrably deep experience with relevant ‘big data’ processing either via Spark or through a modern MPP database like Redshift, ideally with experience in both
Demonstrably deep experience with CI/CD tools and practices in a containerized AWS environment, from deployment pipelines (Jenkins, etc), infrastructure definition (Terraform, CloudFormation, etc.
Understand and design for non-functional concerns such as performance, cost optimization, maintainability, and developer experience.
Strong communication with engineers, product managers, and Architects

Name: Dharmaveer

Title: Sr. recruiter

Intellisoft Technologies, Inc.

1320 Greenway Dive, #460. Irving, TX 75038

Ph : 9727561212x 128

dharma AT intellisofttech DOT com

http://www.intellisofttech.com
Equal Employment Opportunity All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

Related jobs

  • Sr Cloud Data Engineer

    , Dallas / fort worth,

    Are you an experienced, passionate pioneer in technology - a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with our US Delivery Center - we are breaking the mold of a typical Delivery Center.

  • Data Engineer

    , Dallas / fort worth,

    Topgolf is seeking a Data Engineer to help drive their mission for advanced insights by building best-in-class data

  • Sr Cloud Data Engineer

    , Dallas / fort worth,

    Are you an experienced, passionate pioneer in technology - a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with our US Delivery Center - we are breaking the mold of a typical Delivery Center.

  • Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Project Delivery Senior Analyst- Senior Data Governance Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel. If so, consider an opportunity with Deloitte under our Project Delivery Talent Model. Project Delivery Model (PDM) is a talent model that is tailored specifically for long-term, onsite client service delivery.

  • Systems Engineer, Cortex

    , Dallas / fort worth,

    Our Mission

  • Software Engineer

    , Dallas / fort worth,

    Description:

  • Structural Engineer 4- Substation- Phoenix Hybrid 1

Job Details

Jocancy Online Job Portal by jobSearchi.