Short Courses
The following short courses were offered virtually by DEPS and ITEA on 1 February 2021 in conjunction with the 2021 Joint Conference on T&E Support
to Prototyping and Experimentation.
Continuing Education Unit (CEU) credits were awarded for completion of the short courses.
Course 1. T&E of HEL Systems
Classification: Unclassified, Limited Distribution C
Instructor: Larry McKee, American Systems
Duration: Half-day course, runs 0800-1200
CEUs awarded: 0.35
Course Description: An introduction to fundamental considerations for the test and evaluation (T&E) of High Energy Laser (HEL)
weapon systems. Students will be given an overview of the various distinct types of HEL testing, including example test concepts/configurations,
considerations for test instrumentation, and key testing issues, such as safety and environmental concerns.
Topics to be covered include:
- HEL employment/testing challenges
- Types of HEL testing
- Lethality phenomenology testing
- HEL effects
- HEL lethality testing types and test diagnostics
- System output testing
- System performance testing
- HEL examples of static ground testing, dynamic OT, OT/Live
- HEL test measures
- Instrumentation Considerations
- HEL instrumentation summary
- Instrumentation protection
- Non-intrusive measurements
- HEL testing considerations
- HEL testing issues
- HEL testing safety
- Test planning tools
Intended Audience: T&E engineers who may be responsible for planning, supporting, and/or executing range tests that involve HEL
weapon systems.
Instructor Biography: Dr. Larry McKee has over 40 years of experience directing and performing RDT&E programs in directed energy
weapon (DEW) T&E, distributed testing, nuclear weapon effects, system survivability, neutral particle beam interactive discrimination, and
high energy laser effects. He joined American Systems Corporation in 2012 and is currently a subject matter expert supporting the Directed
Energy Test Technology Area under the Test Resource Management Center. He has also developed and presented High Energy Laser T&E short
courses for the Electronic Warfare Directorate at Edwards AFB, CA.
Course 2. T&E of HPM Systems
Classification: Unclassified, Limited Distribution C
Instructor: Jeff Schleher, American Systems
Duration: Half-day course, runs 0800-1200
CEUs awarded: 0.35
Course Description: The short course is an introduction to the testing of high power radio frequency weapons. The course contains a short introduction to the fundamentals of these high power microwave (HPM) weapons to establish a common vocabulary. The focus of the course is on test practices as they apply to HPM weapons for U.S. system testing and susceptibility
testing as specified in MIL STD 464C. HPM instrumentation, test measures, and analysis make up a section of the course. Various presentations address military applications of HPM weapons and how fielded systems have been tested. Substantial new HPM test equipment has been recently made available to military test ranges and developmental laboratories. The course will address the
availability, location, and procedures for these test capabilities as well as the process used to determine what test equipment was needed. A portion of the course will address the specialized requirements of these systems for safety considerations and permitting required for testing to proceed.
Topics include:
- HPM Fundamentals
- Testing Fundamentals as Applied to HPM
- Test and Evaluation HPM Environment
- Sources for HPM Testing and Where to Find Them
- HPM Test Locations
- HPM Test Instrumentation and Setup
- Safety and Spectrum Management
Intended Audience: This course is appropriate for managers and analysts requiring an overview of HPM weapons and how they are tested
in addition to new HPM field test engineers. A background in science and engineering at least to the technicial level is required to understand
the technical portion of the course.
Instructor Biography: Jeff Schleher has spent 40-years in military test and is an early member of ITEA, participating in concept,
developmental, and operational test. Mr. Schleher's early test activities focused on large radar and space system testing, but since the 1990's
he has engaged in high power microwave test support. Mr. Schleher's current activities are as a subject matter expert for the Test Resource
Management Center science and technology efforts to provide military test ranges with necessary equipment and capabilities to support testing
of high powered microwave weapon and modern electronic warfare systems. Previously, he supported the acquisition of high power microwave sources
and sensors through the Directed Energy Test and Evaluation Capability. Mr. Schleher is retired from the Air Force and is the current president
of the Albuquerque Chapter of the Association of Old Crows.
Course 3. Introduction to the DoD Test & Evaluation Process
Classification: Unclassified, Limited Distribution D
Instructor: Harry Sinsheimer, DE JT0
Duration: Half-day course, runs 0800-1200
CEUs awarded: 0.35
Course Description: This course discusses the fundamentals of testing DoD systems, with an emphasis on
directed energy systems. Topics include:
- Overview of Defense Acquisition System
- Where do we start? - Good requirements
- The role of the Systems Engineering process
- Test Planning - when and what do we do it?
- Test Development Strategy
- Test & Evaluation Master Plan
- Role of Test Lead manager
- Types of testing/when started/finished
- Developmental Testing
- Initial Operational T&E
- Live Fire T&E
- Test execution and reporting
- Directed energy testing issues
- Instrumentation
- Safety
- Training
- Best practices and lessons learned
- Some important test parameters of laser systems
Intended Audience: While the primary audience for the course remains DoD staff, DEPS shares the course broadly, not
as a blueprint, but in a spirit of collegiality and an interest in contributing to others' efforts and continuing our collective
dialogue about Directed Energy. As a basic introduction to T&E, it is suitable for personnel in other technical acquisition
management and program management positions who want to understand more about T&E and the critical role it plays in DE system
acquisition.
Instructor Biography: Harry Sinsheimer serves as the Deputy Director to the High Energy Laser Joint Technology Office
since February 2017. As the Deputy Director, Harry's expertise, knowledge, and skills including an understanding of laser
technology, directed energy weapons, test and evaluation, financial management, logistics, program analysis, organizational and
force structure will advocate, develop and execute a High Energy Laser investment strategy that builds on existing programs
while exploiting promising new technology developments for High Energy Laser weapon system applications. Prior to this role
Harry was a business consultant helping small scale companies build strong functional organizations while implementing strategic
planning, programming, and progressive execution of tasks and business processes. Harry's 34 year government career included
serving as Technical Advisor and Program Manager on several Missile Defense Agency's Advanced Laser and Sensor projects after
serving a wide range of roles and responsibilities on the Airborne Laser Program, cradle to grave, from 1995 to 2012 gaining
valuable experience on laser weapon systems. Harry earned a Master's Degree in Project Management from Penn State Erie, the
Behrend College in 2006 and earned a Master's Degree in Business Administration from the University of New Mexico - Robert O.
Anderson School of Management in 1999.
Course 4. Introduction to Cybersecurity T&E
Classification: Unclassified, Public Release (Dist A)
Instructor: Pete Christensen, American Systems
Duration: Half-day course, runs 0800-1200
CEUs awarded: 4
Course Description: This tutorial is intended for managers and practitioners who are required to conduct test and evaluation of systems operation in Cyberspace. The tutorial introduces key concepts associated with Cyberspace and Cyberspace Operations. The material will cover both Offensive Cyber Operations and key avenues of attack as well as Defensive Cyber Operations and strategies for defending against those attacks. With respect to the DOD 5000 and DOD Acquisition Processes we will discuss approaches for developing and testing systems to ensure mission effectiveness in a contested Cyber Environment. Finally, we will overview available resources and ongoing initiatives to improve Cyberspace T&E.
Intended Audience:
Instructor Biography:
Course 5. TENA & JMETC for Distributed Systems Engineering CANCELLED
Classification: Unclassified, Public Release (Dist A)
Instructor: Gene Hudgins, KBRWyle, TENA/JMETC
Duration: Half-day course, runs 0800-1200
CEUs awarded: 4
Course Description: Together, TENA and JMETC enable interoperability among ranges, facilities, and simulations in a timely and cost-efficient manner. TENA provides for real-time system interoperability, as well as interfacing existing range assets, C4ISR systems, and simulations; fostering reuse of range assets and future software systems. JMETC is a distributed, LVC capability which uses a hybrid network architecture; the JMETC Secret Network (JSN), based on the SDREN, is used for secret testing and the JMETC Multiple Independent Levels of Security (MILS) Network (JMN) is the T&E enterprise network solution for all classifications and cyber testing. JMETC provides readily available connectivity to the Services' distributed test and training capabilities and simulations, as well as industry resources. This tutorial will address the current impact of TENA and JMETC on the Test and Training community; as well as its expected future benefits to the range community and the Warfighter.
Intended Audience:
Instructor Biography:
Course 6. Design of Tests for Transitioning DE Weapon Systems to Acquisition Programs for Warfighter Fielding
Classification: Unclassified, Limited Distribution D
Instructors:
- Robert Newton, USAF, Retired
- Dan A. Isbell, USAF, Retired
Duration: Half-day course, runs 1300-1700
CEUs awarded: 0.35
Course Description: Test & Evaluation (T&E) of Directed Energy (DE) Systems is nothing new; however, the purpose of testing is changing.
DE's many decades of research focused testing is now transitioning to support programs of record that lead to fielded DE weapons systems. This
course is designed as an entry level short course where the instructors will briefly review the T&E processes and highlight applicable DoD guidance.
Since Directed Energy (DE) is a technology very different from the kinetic weapons that form the basis of DoD written guidance, the instructors will
apply the core T&E principles to DE weapon system development. This will include familiarization about methodologies along with unique test range
resources that are required for DE weapons T&E.
There are differences in DE T&E phases. For instance, laboratory Research and Development (R&D) T&E has a science and engineering focus. In contrast,
DE T&E for defense acquisition of fieldable DE weapons for warfighters has a more combat operational focus. The course will highlight the distinct
differences between these types of DE T&E to include the spectrum of R&D T&E, Developmental T&E (DT&E) and Operational T&E (OT&E).
The phases of DT&E and OT&E for DE weapon systems are the types of testing that lead to fielding a DE weapon system after it has been proven to
meet technical system performance requirements, military utility, and operational suitability requirements. These combat-relevant areas of T&E also
include Logistics T&E (LT&E), which are focused on validated reliability, maintainability, sustainability and other specific logistics requirements
that help to determine DE weapon system mission availability in a realistic combat environment.
The course will emphasize the need to consider integrated mission-level T&E for DE weapons, since the cost (in time and resources) is very high
if done in a sequential DT&E followed by OT&E, followed by LT&E (as was historically done for other types of systems). Live fire testing of DE weapon
systems is costly, and the resources are precious and few in terms of full-scale DE weapon systems test ranges and instrumentation. Careful design
of test principles can result in much more effective and efficient DE weapons T&E by integrating all the elements of DT&E, OT&E, and LT&E to the
maximum extent possible.
Intended Audience:To understand the material in this course, the attendee should have already completed DE 101, or have prior familiarization with DE weapon systems.
Instructor Biographies: Robert (Bob) Newton is an advanced systems developer with nearly 20-year DE experience. Currently he leads a defense
technology company in applying his over 35 years of US Air Force and commercial industry experience. Beginning with a technical education in Aerospace
Engineering from The Ohio State University and the Georgia Institute of Technology, his mission perspective comes from F-16 fighter and special
operations. He is an acquisition professional and test pilot with over 4500 hours in over 60 types of aircraft. His specific acquisition related
responsibilities involved F-16 performance / flying qualities / avionics / sensors / weapons flight test and airworthiness certification, F-22
program management, Air Force Material Command headquarters, Pentagon Air Staff, and industry. He has commanded flying units and is a veteran
of Operations ENDURING FREEDOM and IRAQI FREEDOM.
Dan Isbell brings a broad range of expertise and experience to the defense and technology industry with his 27 years of service in the US Air Force.
His insight comes from an educational background that includes a Master's degree in National Resource Strategy from the National Defense University, a
Master's degree in Human Resource Management from Troy State University and a Bachelor of Science degree in Aerospace Engineering from Georgia Institute
of Technology. During his Air Force career he also completed flight school, test pilot school, Senior Acquisition Manager's course, Industrial College
of the Armed Forces and the professional military service schools.
Mr. Isbell's formal education and training founded his broad experience in aircraft and weapons airworthiness certification and program management,
business development and integration, technology and engineering, fighter aircraft and special operations. His positions include Chief, F-16 Systems
Program Office, Commander of 514th Flight Test Squadron, Operations Research Systems Analyst for Assistant Secretary of Defense for Program Analysis &
Evaluation, Air Vehicle Program Manager for F/A-22 Systems Program Office, Chief of Weapon System Sector and Technology Integration Lead for Battlefield
Air Operations Kit National Team.
Course 7. Combat Systems Engineering of DEWs
Classification: Unclassified, Limited Distribution D
Instructor: Douglas H. Nelson, Teknicare, Inc.
Duration: Half-day course, runs 1300-1700
CEUs awarded: 0.35
Course Description: An introduction to the test and evaluation of directed energy weapon systems as they
are designed, developed and realized to perform their intended military missions. The fundamentals of the combat
systems engineering approach will be introduced to provide context and comparison to systems engineering models
commonly in use. The role of test and evaluation in the steps/activities of this combat systems engineering process
as tailored to directed energy systems will be briefly examined.
Intended Audience:
Instructor Biography: Doug Nelson received his Bachelor of Science in 1980 from the United States Military
Academy (USMA), West Point, NY where he concentrated in physics with a specialty in weapons systems engineering. After
graduation, Doug finished the Armor Officer Basic Course at Fort Knox, KY. He then completed a series of operational
tours in Korea and CONUS serving as a tank platoon leader, tank company executive officer, tank company commander as
well as various brigade & battalion staff positions. Doug then graduated from the Armor Officer Advanced Course at
Fort Knox in 1986 subsequently earning Master or Science. in physics from the Naval Postgraduate School (NPS), Monterey,
CA, in 1988. While at NPS, he conducted research in the analysis of selected atmospheric optical turbulence effects on
the Relay Mirror Experiment. Upon graduation from NPS, he was an instructor and assistant professor of physics at USMA
concurrently graduating from the Command & General Staff College, Fort Leavenworth, KS. In 1991, Doug then redeployed
to Korea for tours as a tank battalion operations officer and brigade logistics officer. Beginning in 1993, Doug served
as a Military Research Associate and upon retirement from the Army in 1997, a Staff Research Assistant, at Los Alamos
National Laboratory (LANL) conducting research in CO2 DIAL. While at LANL, Doug earned his PhD in Optical Science from
the University of New Mexico in 1999.
In 2000, Doug transitioned to industry, first with Raytheon Missile Systems in Tucson, AZ where he conducted test
planning and analysis on AIM-9X Sidewinder. In mid 2001, he transferred to The Boeing Company where he managed and
contributed technically to various programs including several in directed energy (DE). Among these were: Relay System
Internal Research & Development, Aerospace Relay Mirror System, Airborne Laser, Advanced Tactical Laser, High Energy
Laser Technology Demonstrator, Active Track of satellite targets, Exo-atmospheric Kill Vehicle, SBInet, Ground Combat
Vehicle as well as several proprietary programs.
In 2011, Doug joined the Systems Engineering Department at the Naval Postgraduate School as an Associate Professor.
There he taught the Directed Energy Systems track as well as the Combat Systems Engineering track and other systems
engineering & project management courses. He also conducted research into mission engineering, atmospheric optical
turbulence effects, combat force protection & survivability as well as high energy laser system and subsystem integration.
He transitioned to the US Army Space and Missile Defense Command in 2016. There his duties included serving as
the Army Representative to the High Energy Laser Joint Technology Office (HEL JTO) Atmospheric Propagation Technical
Area Working Group (AP TAWG) and the Modeling & Simulation (M&S) TAWG.
Doug is now the Senior Combat Systems Engineer with Teknicare, Inc. supporting several government programs. Areas
of expert support include beam control, combat systems engineering and DE test & evaluation.
Course 8. HPM M&S Tools for T&E
Classification: Unclassified, Limited Distribution D
Instructors: J Mark DelGrande, Verus Research
Day/Time: Half-day course, runs 1300-1700
CEUs awarded: 0.35
Course Description: The Directed Energy Test & Evaluation Capability (DETEC) has developed two software
tools to facilitate High Power Microwave (HPM) testing: HPM Test Hazard Prediction (THP) Tool and the HPM Target
Surrogate Material (TSM) database. This short course presents an introduction to both.
Drawing from propagation codes such as RF-PROTEC and the EMPIRE Suite, THP provides the T&E community with critical
tools and information to mitigate safety and hazard risks to personnel and electronics during open-air tests of HPM
systems. THP's essential functions include:
- Support safety and regulatory compliance by calculating and displaying hazard boundaries
- Prepare frequency clearance applications in Standard Frequency Action Format (SFAF)
- Aid in identifying potential harmful effects to non-test site electronics
- Display specific locations or boundaries with specified field levels
In this portion of the short course, students will see the code in action while instructors discuss: Modeling the
Physical Scene, Specifying Scenario Input Parameters, Understanding & Selecting Propagation Models, Graphical
Visualization and Output Products, Hazard Thresholds and Hazard Zones, Standard Frequency Action Format, Basic Weather
and Atmosphere Models, transferring environmental data to THP, Loading and Using HPM Electric Field Sensor Data in THP.
The TSM database is a browser based repository of information on hazardous materials as well as surrogates that can be
substituted for these hazardous materials during HPM testing. The purpose of the tool is to provide the HPM T&E
community with access to a database that contains information on hazardous materials, how to handle those materials
during test, and commonly available materials that can be substituted for the hazardous materials. The TSM database's
essential functions are to:
- Access to the electromagnetic properties of hazardous materials
- Suggestions for safe substitutes for those materials, to include electromagnetic properties
- Test Range unique restrictions on hazardous materials
- Hazardous material handling instructions, including cleanup procedures
In this portion of the short course, students will see TSM in action while instructors discuss: Finding the
electromagnetic properties of a hazardous material; Finding a surrogate for the hazardous material; Making plots of
material properties as a function of temperature and frequency; Entering new materials into the database; Extracting
the original sources of the electromagnetic data.
DEMER: The Directed Energy Models and Effects Repository's (DEMER) was created to aid and encourage the distribution of and collaboration on directed energy (DE) modeling and simulation (M&S) tools and effects data throughout the wider DE community.
An appropriate collaborative environment was established to provide for community wide discovery of DE tools and effects data which balances security with utility. The distribution format ensures owners and creators the freedom of development for, and
confidence in the ownership of, their products. To reach this end, DEMER's overarching philosophy will be 'Local Management, Enterprise Discovery.' DEMER is a secure web-based card catalog of meta-data files describing the current M&S capabilities and
effects testing efforts. Using a meta-data format favors autonomy for resource owners by only describing pertinent details of their products, without surrendering control to a centralized database. The repository also provides the capability for members and agencies to catalog and organize their M&S and effects testing products internally, only sharing with the wider community those products they deem appropriate. In this portion of the short course, students will be given a walk-through tutorial on how
to register and use the DEMER database.
HPM PULSE: The High Power Microwave Procedures Leading to Standardized Effects (HPM PULSE) is a guidebook designed to
standardize HPM effects testing and is meant to be used by both experienced and novice effects test personnel. It provides
best practices and useful information on common aspects of HPM effects testing. The information included in HPM PULSE will aid
personnel with test design and setup, as well as provide various quick reference charts, formulas, and other background
information for use during the test execution. During this portion of the short course, students will receive an overview of the
HPM PULSE guidebook to better understand how it can be used to aid in conducting HPM effects tests.
Intended Audience: The intended users of these HPM tools are test planners, spectrum managers, range safety
personnel, test technicians or engineers, and environmental personnel involved in HPM testing.
Instructor Biography:
Course 9. T&E in Support of Prototyping & Experimentation
Classification: Unclassified, Public Release (Dist A)
Instructor: Al Sciarretta, CNS Technologies, Inc.
Duration: Half-day course, runs 1300-1700
CEUs awarded: 4
Course Description: As one of the principal developers of a prototyping and experimentation course at the National Defense University (NDU), Al Sciarretta will provide a tutorial that addresses 1) definitions of prototypes and experiments, 2) a design of experiments (DOE) approach for developing and executing an experiment, and 3) a high-level example that addresses developing an experiment for counter-small unmanned aircraft system (counter-sUAS) systems.
1. A 30-minute block of instruction that includes: 1) discussion about the importance of prototyping and experimentation; 2) definitions for conceptual, developmental, and operational prototypes; and 3) definitions for live, virtual, and constructive experiments
2. A 3-hour block of instruction covering a DOE approach for designing an experiment. This instruction will walk through a process that: 1) identifies the military capability/problem that requires experimentation, 2) defines the primary objective and optional secondary objectives for the experiment; 3) generates “issues” that need to be addressed; 4) identifies hypotheses that need to be proved/disproved; 5) identifies metrics that are need to prove/disprove each hypothesis; 6) discusses data needs for each metric; 7) develops the scenario/vignettes that will maximize the generation of the needed data; and 8) identifies approaches (both instrumentation and non-instrumentation) for collecting the data. [Note: Given the brevity of the course, the identification of issues, hypotheses, metrics, and data needs will not be all inclusive; examples of each will be used to generate student discussion.]. Finally, at the end of this block of instruction, there will be a short discussion of what should be in an experiment plan as well as a short discussion of some considerations for executing the experiment plan.
3. A 30-minute group effort that uses the two blocks of instruction to develop a basic approach for designing an experiment for assessing the military benefits of counter-sUAS systems. This effort will mostly focus on identifying some of the objectives, hypotheses, issues, metrics, and data/instrumentation needs. The development of a representative threat will also be discussed.
Intended Audience:
Instructor Biography:
Course 10. Predicting & Validating Prototype Performance
Classification: Unclassified, Public Release (Dist A)
Instructor: Mark Kiemele, Air Academy Associates
Day/Time: Half-day course, runs 1300-1700
CEUs awarded: 4
Course Description: Design of Experiments (DOE) is a method that can and should be used in the design
and development of prototypical systems. But DOE should also be used in validating the performance of prototypes
so that procurement decisions can more easily be made. This tutorial will examine the design and development of
two prototypes that are built to satisfy a common set of requirements. DOE will be used to model the performance
of each prototype. Then validation testing will be used to confirm the performance capability of each prototype,
thereby enhancing the decision as to which system to procure. This will be a highly interactive session and
should be fun for the participants. There are no pre-requisites to attend, as the analysis will be demonstrated
via computer.
Intended Audience: This session is for any leader, manager or practitioner who wants to develop a better
understanding of what needs to be done to predict the performance of a prototype system and then to be able to
validate that predicted performance after the prototype has been built. No prior statistical knowledge is needed
to garner the key principles/take-aways from this session.
Instructor Biography: Mark J. Kiemele is President and Co-founder of Air Academy Associates. He has
more than 35 years of teaching, coaching, and consulting experience. He is world-renowned for his Keep-It-Simple-Statistically
(KISS) approach to developing a culture of experimentation. His support is requested by an impressive list of global
clients, including Sony, Microsoft, GE, Apple, GlaxoSmithKline, Samsung, John Deere, Xerox, and Bose, as well as many
DoD contractors and organizations.
Mark earned a B.S. and M.S. in Mathematics from North Dakota State University and a Ph.D. in Computer Science
from Texas A&M University. During his time in the USAF, Mark supported the design, development and testing of various
systems. He has more than 100 published papers and has authored or co-authored seven books.
| Course Fees |
|
| |
Single Half-Day
|
Two Half-Day
|
| All Attendees |
$300
|
$550
|
Registration
- Complete this form to register on-line.
Note that on-line registration does not require on-line payment.
Some organizations have installed web filters that prevent on-line registration
from inside their facilities. If this appears to be true for you, please try again off-site
or use the registration option below.
- Print this registration form (in PDF format) and follow the instructions provided.
Persons requesting cancellation through 4 January will receive a full refund. Cancellations after
4 January are subject to a $100 cancellation fee. No refunds will be given after 29 January.
Last updated: 1 April 2021
