Security Data & Automation Engineer

* Must be eligible for a federal security Clearance (U.S. citizen) * Must be able to work on-site in Oak Ridge, TN A Department of Energy Research and Development facility is looking for a Security Data & Automation Engineer. This person will be responsible for acquiring, ingesting, transforming, and operationalizing data from diverse sources into storage and processing systems. This role is critical to ensuring data is accurate, secure, and ready for analysis, while also supporting custom application development, automation, advanced integrations, and AI capabilities. **Specific duties and responsibilities include:** 1. Data Acquisition and Pipeline Development * Identify and connect to data sources such as databases, APIs, file systems, and streaming platforms. * Develop, automate, and maintain scalable data pipelines and ingestion workflows. 2. Data Transformation, Cleaning, and Integration * Process raw data into usable formats through parsing, validation, enrichment, and conversion. * Integrate data from multiple sources into cohesive, reliable datasets. 3. ETL, Automation, and API Integration * Design, implement, monitor, and optimize ETL processes, automation flows, and advanced API integrations. * Troubleshoot ingestion, workflow, and integration issues to ensure consistent performance and scalability. 4. Application Development and AI Integration * Develop and maintain custom applications and automation tools using Python and Git-based workflows. * Support advanced AI integration, including hardware/software deployment and inference optimization. 5. Data Storage, Security, and Compliance * Ensure data is stored securely and remains accessible to downstream systems and users. * Document ingestion processes, transformations, and sources while maintaining compliance with governance and regulatory requirements. Skills and Tools Commonly Used * Proficiency in Python and experience with Git-based development workflows. * Experience with ETL, automation, and integration tools such as Apache NiFi, Talend, Informatica, or similar platforms. * Familiarity with APIs, orchestration, and workflow automation. * Knowledge of Kafka, Spark, Hadoop, and cloud platforms including AWS, Azure, or Google Cloud. * Knowledge of AI/ML integration, inference workflows, and supporting hardware/software environments. * Strong problem-solving and analytical skills.