Senior Data Engineer

Description:

Role Responsibilities:

- Primary Skills: Informatica Big Data Management

Required Skills:

- Informatica Big Data Management: 4+ years of development and design experience

- Oozie Scheduling: Extensive knowledge and experience

- HQL, Hive, HDFS: In-depth understanding and hands-on experience

- Data Partitioning: Proficient in designing and implementing data partitioning strategies

- SQL and NoSQL databases: Extensive experience working with various databases

- Linux OS configuration and use: Strong knowledge and hands-on experience

- Shell scripting: Proficient in writing shell scripts for automation and configuration

- Design patterns: Well-versed in design patterns and their implementation

- Agile, DevOps, and CI/CD: Experienced in Agile methodologies and DevOps practices

- Distributed services resiliency and monitoring: Familiar with monitoring and troubleshooting distributed services

- Security systems: Experienced in designing, building, testing, and implementing security systems

- Compliance and regulatory requirements: Knowledge of encryption, anonymization, data integrity, and policy control features

- Networking: Understand basics of DNS, Proxy, ACL, Policy, and troubleshooting

- Data sensitivity: Aware of logging, events, and in-memory data storage best practices