AI & Data Science Intern - GPSU/NE

GuidePoint Security provides trusted cybersecurity expertise, solutions and services that help organizations make better decisions and minimize risk. By taking a three-tiered, holistic approach for evaluating security posture and ecosystems, GuidePoint enables some of the nation’s top organizations, such as Fortune 500 companies and U.S. government agencies, to identify threats, optimize resources and integrate best-fit solutions that mitigate risk. Overview As part of the GPSU program, we are seeking an AI & Data Science Intern to support GuidePoint Security’s Northeast region. In this role, you will work with the NE AI and AppSec teams as part of the NE DevSecOps team, contributing to the evaluation and governance infrastructure that supports GuidePoint’s agentic AI harnesses. This is a hands-on, practitioner-mentored role focused on defining and running evals, collecting and analyzing telemetry, tuning model performance, and building an internal governance pipeline for AI harness outputs. Prior professional experience is not required, but a data-oriented mindset and curiosity about applied AI systems are essential. Currently enrolled, or recently graduated with a degree or substantial coursework in data science, statistics, computer science, engineering, or a related field is required. You will contribute to live AI systems that are in active use across the organization, working alongside experienced engineers to improve harness reliability and prevent output drift and performance regression over time. You will also participate in limited client-facing engagements under mentorship, observing how AI capabilities are communicated and demonstrated in a professional services context. Responsibilities Evaluation & Performance Define and implement evaluation frameworks to measure the accuracy, reliability, and consistency of agentic AI harnesses Design and run structured evals against harness outputs to detect regressions, output drift, and behavioral degradation over time Build and maintain benchmark datasets and ground-truth corpora used to evaluate harness quality Analyze eval results, identify failure modes, and collaborate with the NE AI and AppSec teams to drive iterative improvements Research and apply prompt evaluation techniques and LLM benchmarking methodologies relevant to security-specific harnesses Telemetry, Tuning & Governance Instrument agentic harnesses with telemetry to capture latency, token usage, error rates, and output quality signals Analyze telemetry data to identify patterns, surface anomalies, and generate actionable insights for harness tuning Support model and prompt tuning efforts based on eval and telemetry findings, documenting changes and measuring their impact Contribute to building an internal AI governance pipeline: defining standards, logging outputs, flagging quality issues, and maintaining an audit trail for harness behavior Document governance processes, eval methodologies, and tuning decisions in a repeatable, version-controlled format Qualifications Currently enrolled, or recently graduated with a degree or substantial coursework in data science, statistics, computer science, engineering, or a related field (required) Proficiency or strong interest in Python, with exposure to data manipulation libraries (pandas, numpy) or LLM APIs Genuine curiosity about large language models, agentic systems, and how AI performs (and fails) in applied contexts Strong analytical and written communication skills, with an ability to translate data findings into clear, actionable observations Technical aptitude and comfort working with ambiguity in a fast-moving, practitioner-led environment Eastern/Central time zone, preferred Internship Details and Expectations This is a part-time, remote paid internship ($20/hr) that runs for 12 weeks, with potential for full-time employment at the conclusion of the internship. Interns are expected to: Be physically located within the United States during the entire duration of the internship Work 25-29hrs/wk Monday-Friday supporting the Eastern Time Zone Have a personal computing device and access to high-speed internet during working hours This position is not available for candidates living in the following states: Alaska, California, Hawaii, New Mexico, New York, Oregon, Washington and Wyoming. The below perks are for those that join GuidePoint Security for full-time employment only. We use Greenhouse Software as our applicant tracking system and Zoom Scheduler for HR screen request scheduling. At times, your email may block our communication with you. Please be sure to check your SPAM folder so that you don’t miss updates on your application. Why GuidePoint? GuidePoint Security is a rapidly growing, profitable, privately-held value added reseller that focuses exclusively on Information Security. Since its inception in 2011, GuidePoint has grown to over 1,300 employees, established strategic partnerships with leading security vendors, and serves as a trusted advisor to more than 6,200 customers. Firmly-defined core values drive all aspects of the business, which have been paramount to the company’s success and establishment of an enjoyable workplace atmosphere. At GuidePoint, your colleagues are knowledgeable, skilled, and experienced and will seek to collaborate and provide mentorship and guidance at every opportunity. This is a unique and rare opportunity to grow your career along with one of the fastest growing companies in the nation. Some added perks…. Remote workforce primarily (U.S. based only, some travel may be required for certain positions, working on-site may be required for Federal positions) Group Medical Insurance options: Zero Deductible PPO Plan (GuidePoint pays 90% of the premium for employees and 70% for family plans (spouse/children/family) or High Deductible Health Plan with HSA (GuidePoint pays 100% of the employees premiums and 75% for family plans (spouse/children/family). If you choose the High Deductible / HSA plan, GPS will contribute in 4 equal quarterly installments: ($850 per EE annually / $1750 per family annually (includes spouse/children/family options) Group Dental Insurance: GuidePoint pays 100% of the premium for employees and 75% of family plans 12 corporate holidays and a Flexible Time Off (FTO) program Healthy mobile phone and home internet allowance Eligibility for retirement plan after 2 months at open enrollment Pet Benefit Option