Job Description
Role: Sr Data Engineer/Informatic PowerCenter with Palantir Foundry + AIP
Location: NYC, NY- 100% Remote
Contract Role: 6+ months
Job Description:
- At least 5 plus years of experience
- Experience on Palantir Foundry + AIP (Artificial Intelligence Platform)
- designing, building and operationalizing data pipelines that feed the enterprise data ecosystem for a variety of multi-faceted analytics created by data consumers.
- needed to guarantee compliance with data governance and data security requirements while creating, improving and operationalizing integrated and reusable data pipelines.
- strong Data Management/Engineering
- experience (Data Integration, Modeling, Optimization and Data Quality); Strong ability in designing/implementing production grade data warehousing solutions on large scale databases such as SQL Server, Oracle or DB2; Needs to have strong Informatica PowerCenter skills; Snowflake DW platform; PL/SQL (must), along with either Shell or Perl scripting abilities.
- Lead construction, maintenance, & optimization of data pipelines.
- Drive Automation through effective metadata management, using innovative and modern tools, techniques, and architectures to improve productivity.
- Lead renovation of the data management infrastructure to drive automation in data integration and management.
- Collaborate with multiple Analytics Center of Excellence teams and EIM team in refining their data requirements for various DNA initiatives and data consumption requirements.
- Identify gaps in new data initiatives and how to address new data requirements.
- Transfer knowledge of data and/or domain understanding in addressing new data requirements.
- Propose appropriate (and innovative) data ingestion, preparation, integration and operationalization techniques to optimize data requirements.
- Work with data governance teams to ensure data scientists and consumers use corresponding data responsibly through data governance and compliance initiatives.
- Minimum 7 years of work experience in data management disciplines, including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.
- Minimum 7 years of hands-on experience designing and implementing production grade data warehousing solutions on large scale databases
- such as SQL Server, Oracle or DB2
- 5+ years data pipeline development experience with Informatica
- 5+ PowerCenter
- 3+ years of experience with advanced analytics tools for
- 3+ Object-oriented/object function scripting using languages such as
- 3+ R, Python, Java, C++, Scala, others 3+ years of experience with
- 3+ Shell/Perl Scripting
- 5+ years of experience with popular database programming languages including SQL, PL/SQL (required), others for relational databases and certifications on upcoming NoSQL/Hadoop oriented databases (preferred) like MongoDB, Cassandra, others for non-relational databases.
- Minimum 2 years designing and implementing a fully operational production grade large scale data solution on Snowflake Data Warehouse.
Preferred Skills:
- Hands on experience with Palantir Foundry + AIP Preferred experience in working with data science teams in refining and optimizing data science and machine learning models and algorithms Full Lifecycle Data Warehouse, Data Mart Development experience is a big plus.
- Agile Software development methodologies Preferred experience with any automation tool such as AutoSys, CNTL-M
Job Tags
Hourly pay, Permanent employment, Full time, Contract work, Part time, Work experience placement, Remote job,