Back to search
Tata Consultancy Services Linkedin · Posted 12d ago

Engineer

Pittsburgh

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Job Description

Python/Spark Developer

Must Have Technical/Functional Skills

  • Strong hands-on experience with Apache Spark and PySpark.
  • Experience with Big Data ecosystems such as Hadoop, Hive, HDFS, and Kafka.
  • Proficiency in SQL and relational databases.
  • Strong understanding of distributed computing and performance tuning.
  • Experience with version control tools such as Git.
  • Knowledge of Linux/Unix environments.
  • Strong problem-solving and analytical skills.

Additional Requirement

  • Good understanding of GenAI concepts and applications
  • Ability to identify opportunities to leverage AI and implement AI-driven solutions where appropriate
  • Exposure to Data Products, Metadata Management, Knowledge Graphs, Ontology, or Semantic Technologies will be an added advantage

Roles & Responsibilities

  • Develop and maintain data processing applications using Python and Apache Spark (PySpark).
  • Design, build, and optimize ETL/ELT pipelines for large-scale datasets.
  • Process and analyze structured, semi-structured, and unstructured data from multiple sources.
  • Implement data transformation, cleansing, and validation frameworks.
  • Collaborate with Data Engineers, Data Scientists, Business Analysts, and stakeholders to understand business requirements.
  • Optimize Spark jobs for performance, scalability, and reliability.
  • Develop reusable components and data processing frameworks.
  • Monitor and troubleshoot production issues related to Spark applications.

Salary Range - $100,000-$120,000 a year

TCS Employee Benefits Summary

  • Discretionary Annual Incentive.
  • Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
  • Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

  • Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
  • Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Qualifications: BACHELOR OF COMPUTER SCIENCE

Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search