Position: Databricks engineer/DeveloperLocation: Bridgewater, NJ Job Description: Hands on experience in PySpark and SQL Spark. Should be aware of Spark best practices, performance tuning etc. Should have experience in Azure cloud. Should have exposure to ADF, ADLS, Databricks, Delta lake Should have hands on experience in writing shell scripts, scheduling of jobs, handling NFRs like restartability, distributed processing etc Should have worked on complex spark transformations that include Joins between large table, lookup over small tables, broadcasting variable, caching etc Exposure to Hadoop, Hive and Impala. Regards, Harshith. M
