Position: Senior Big Data Engineer Location: Nashville, TN (Remote) Duration : Fulltime with Innova Solutions.com Responsibilities
Design, modify, implement, test, and provide operational support for enterprise software products and platforms, including software infrastructure and development tools for the Data
Develop, operate and drive scalable and resilient data platform to address the business requirements
Create new opportunities in this space for EHA platform with new feature capabilities and new offerings that drive customer and business value
Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
Engages in building solutions leveraging technologies including but not limited to Python, Scala, Spark, Hive and AWS services such as EC2, S3, ECS, Lambda, EMR, ELB, SNS, Glue, Athena and SageMaker
Critical Skills Required
Strong knowledge of AWS cloud infrastructure compute, networking, storage and other AWS cloud services
Proven experience with AWS services such as Data Pipeline, Step Functions, Batch, Lambda, CloudFormation, CloudWatch, EC2, EMR, SNS, IAM, ELB, EC2, S3, Redshift, Glue
Experience with Big Data tech stack, including Hadoop, Java, Python, Spark, PySpark, Scala, and Hive, Columnar and NoSQL data stores
Knowledge and previous experience with Unix and Linux
Demonstrates strong drive to learn and advocate for development best practices
Experience working with large datasets and large-scale distributed computing
Working knowledge of building out data marts, data warehouses, data lakes preferred
Experience on ETL data pipelines development and performance tuning
Experience with manipulating and transforming data
Experience on columnar databases like Redshift or Snowflake preferred
Working knowledge of containers and container orchestration
Proficiency using Kubeflow, Airflow or any other workflows
Regards,
Surya Puvvula Lead Talent Acquisition Innova Solutions Inc Desk No:- 408 – 889-2020 ext 433 Cell No: Email:-srisuryann.puvvula@innovasolutions.com Address: 3211 Scott Blvd, Suite # 202, Santa Clara, CA 95054
