Data Engineer

Company: Dice.com
Location: Charleston
Posted on: May 14, 2020

Job Description:

Title Data Engineer Location Charleston, SC Duration 12 months (Right to hire) Job Description Establishes Data Lake in AWS cloud environment with APIs to access various tiers of data. Works with the full open source Hadoop stack to include cluster management, data repositories, analytics software, and schedulers. Works in public, private or government cloud environments to build scalable systems. Determines the appropriate database given the data and analytics needs, whether file structures such as HDFS, relational databases including NewSQL, non-relational NoSQL databases including in-memory databases. Establishes the extraction of data from legacy data systems into the proposed solution to be able to transfer as required externally with other systems and or organizations (i.e., the VA, Cerner) and understands Data Governance for Normalizing, Cleansing and Standardizing the legacy data for retrieval and viewing purposes. Optimizes the distribution of data across nodes and the performance of NoSQL repositories and is familiar with installing in the Amazon Web Services (AWS) Government Cloud environment. Identifies performance bottle-necks and evaluates scaling benchmarks. Participates with senior management to establish strategic plans and objectives. Acts independently to uncover and resolve issues associated with the development and implementation of operational programs. Recommends technological application programs to accomplish long-range objectives. Required skills and education Bachelors and five (2-4) years or more experience Masters and three (2-3) years or more experience PhD and 0 years related experience. Must have experience in at least 5 (five) the following technologies. AWS Government Cloud Amazon RedShift Amazon RDS Aurora NetApp Data Warehousing Data Lakes QLIK Tableau Talend Informatica Red Hat OpenShift and Ansible Python R GUI Spark Carepoint. Extensive experience with full open source Hadoop stack, Cluster Management, Big Data Repositories (Warehouses, Lakes) and Cloud-Based Data Management Tools, Principles and Methodologies. Custom database sources could include SQL, Oracle, AWS Red Shift, PostGreSQL, Mongo DB, etc.) Experience supporting implementations moving data into Amazon Web Services (AWS) Government Cloud environment. Able to build business intelligence data mapping between data elements across various legacy health clinicalmedical data systems. Understand merging medically coded data across coding types such as SNOMED CT, ICD10, CPT, CCS, etc. Able to build Data Warehousing with the ability to query the stored data for Business Intelligence, Analytics, and Reporting. Support storage retention and disposition of data. Expertise in and with Defense health clinicalmedical data working in the healthcare industry. Ability to obtain a Public Trust clearance

Keywords: Dice.com, Charleston , Data Engineer, Engineering , Charleston, South Carolina