MVQS
Year 2005 Technical Update Relative to Frye & Daubert Standards
The McCroskey Vocational Quotient System
(MVQS 2005.02) consists of three primary components: the McCroskey Dictionary of Occupational Titles (McDOT), the McCroskey TestPlot (McPLOT) and the McCroskey Transferable
Skills Program (MTSP).
MVQS programs stem from the MVQS McDOT, McPLOT and MTSP Program Series [(4th
Edition Versions 6.2-8.0R, (McCroskey, 1992-99), 5th Edition
Versions 2000 & 2001, (McCroskey, 2000, 2001) and 6th Edition,
Upgraded, Updated and Revised, Versions 6.0-2005.02 (McCroskey, 2005)].
Predecessors to MVQS were DataMaster Programs (Vers.
1-4P; 1982-91)]. All three components have been seamlessly integrated into the MVQS Volcano 3.0 - 5.02 Supplemental Program
Series (McCroskey, 2003-05).
MVQS
Programs and their predecessors have been widely used and accepted for their
helpfulness in determining individual employability and earning capacity in the
US and Canada. To date, these programs have been used by Vocational Experts, Rehabilitation Counselors, Vocational Evaluators,
College Counselors, Rehabilitation Economists, Earning Analysts, and related
professionals, in more than 45 US States and Canadian Provinces. MVQS
Programs are underpinned by the Minnesota
Theory of Work Adjustment and the Vocational Diagnosis and Assessment of
Residual Employability (VDARE, McCroskey, 1979) and standardized methods,
procedures and instrumentation. They have long since met the Frye Test of General Acceptance (Frye v. US, 293 F. 1013, 1923) in
Scientific Vocational Rehabilitation and Related Communities.
In addition to wide spread usage, on-going
peer-reviewed, published, research has firmly established strong scientific
reliability and validity for the MVQS
Transferable Skills Analysis paradigm (Grimley, et. al., 2000a, 2000b; Dunn,
Williams & Bast, 2003, 2005) and Pre/Post Earning Capacity Range Estimation
algorithms (JOFV, Vols. 1-8). MVQS Programs meet the application of key
standards discussed in the 1993 US Supreme Court Daubert decision (Daubert v.
Merrill Dow Pharmaceuticals, Inc., 113 S. Ct. 2786, 1993; Standards
re-affirmed in: Kumho Tire Co. v
Carmichael (97-1709) 131 F.3d 1433, reversed, S. Ct., 1998, & Kinneman v. Ford Motor (2001). The key Daubert Standards, which apply
equally to scientific, technical and
other specialized knowledge, and a brief synopsis of how MVQS Programs meets each, are briefly
discussed below:
1.
Tested theories, methods, procedures & instrumentation used by
experts. MVQS
programs are used in more than 45 US States and backed by peer-reviewed,
published, VI research, with independent replication and predictive validity
generalization cross validation studies with more than 50 published Predictive Validity Coefficients in the Very High to Extremely High range. Additional Cross validation research studies
on many states have been completed on MTSP Programs. Predictive Validity Coefficients have consistently been reported to
be in the Very High to Extremely High range with reasonable
Standard Errors of Estimate (SEE).
2
Peer reviewed publication of theories, methods, procedures and
instrumentation.
Peer-reviewed in all three Job-Person
Matching System Comparison Monographs. Scientific research generated
includes several doctoral dissertations and masters theses. Presentations have
been made at numerous national and state professional-level conferences (e.g.,
ABVE - Spring 2000, CALNARRP - Fall 2000, MARP - Fall 2000, CARP - Ontario,
Canada, Fall 2001, ABVE - Fall 2002, and IARP - Fall 2003). Databases have been
independently reviewed and studied. Scientific research articles and
independent replication studies have been published in books, manuals,
monographs and peer-reviewed journals. Publications include multiple
Volumes/Issues and Monographs of: The
Vocationologist, The Journal of Vocationology (JOV). The ABVE Journal of
Forensic Vocational Assessment (JFVA, 2001). The Journal of Forensic
Vocationology (JOFV 2000, 2004). The American Rehabilitation Economic
Association (AREA) Monograph #1. The American Board of Vocational Experts
(ABVE) Monograph #1. The ABVE Vocational Expert. The Earnings Analyst (TEA)
Journal of the American Rehabilitation Economic Association), The
International Association of Rehabilitation Providers (IARP) Fall Conference
Proceedings: Comparing Job-Person Matching Systems CD-ROM, 2003. And, The
ABVE Journal (JFVA, Vol. 8 Issue 1, 2005).
3
Known error rates (frequency of erroneous results).
For MTSP 8.0R, the Predictive Validity Coefficient for using the VQ to predict
earning capacity were established relative to Job Service Work Order Openings
to be extremely high with Rxy=0.91, R2=0.83, SEE
= $0.50/hr [McCroskey & Hahn (1998). [In: The Earnings Analyst Vol. 1(1), Spring Edition; 1998, pp. 39-80;
reprinted in: Journal of Forensic
Vocationology, Vol. 4(1), Spring Edition, 1998, pp. 11-52]. Other studies
(McCroskey & Dennis, The Earnings
Analyst Vol. 2(1), Spring, 1999) and Dennis & McCroskey, (the Journal of Forensic Vocationology, Vol. 5(1),
Spring, 1999), have explored reliability, validity and standard errors of
estimate rates of MTSP earning capacity predictions relative to Occupational
Unit Classification Code (OUC Code) OES wages. Authors reported very high
validity & relatively small standard errors of estimate (Rxy=0.68,
R2=0.46, SEE = $1.01/hr). Mayer (1999), [Journal of Forensic Vocational Assessment,
Vol 1(3), Spring 1999], completed a follow-up study of N=132 randomly
selected, successfully re-employed 1993 Indiana State Rehabilitation Counselor
Services Recipients. Mayer provided additional insight through her empirical
cross validation research study demonstrating strong predictive validity and
reasonable error rates for the MTSP 7.11R program, relative to known starting
wage at placement outcomes. Dr. Mayer found MTSP post-injury starting earning
capacity range estimates accurate within + or - 1 SEE ($1.31/hr)
when compared to actual wage-at-placement outcomes. Replication studies using
MTSP 8.0R & MTSP 2001 had similar findings (Dennis, 1999, Dennis &
McCroskey, 2001). The Grimley, Williams, Hahn & Dennis MTSP TSA study [JOFV Vol. 6(1), 2000a, JFVA,
2000b] found very high TSA validity. McCroskey, Hahn & Dennis [JOFV, Vol.
6(1), 2000], using the Occupational Employment Statistics (OES) 92% sample of
US worker wages, reported Rxy Coefficients (for Mean, 10th,
25th, 50th, 75th and 90th
Percentile Wage Estimates) of Rxy=0.970, 0.973, 0.975, 0.974, 0.972
and 0.966, respectively. Standard Errors of Estimate measures, reported by the
authors for the Mean, 10th, 25th, 50th, 75th
and 90th Percentile Wage Estimates were: SEE=$1.19,
$0.45, $0.69 $1.08, $1.65 and $2.66 per hour, respectively. These studies laid
scientific foundation for the reliability & validity of the MVQS
2002-2005.02 and Volcano 4.1-5.02 TSA methodology (Rxy=0.48-0.96; SEE=6.7%)
and the MVQS 2002-2005.02 curvilinear 6-point Pre/Post Earning Capacity Range
Estimation methodology (See Tables 4 & 4a, JOFV Vol. 7(1) p. 174 & Vol.
8(1), p. 171).
4
The existence and maintenance of Standards. From 1981 to 2005,
Technical Program Manuals on MVQS Theory, Methods &
Instrumentation have been published and in peer-reviewed publications [e.g., Journal of Vocationology, Vol. 1 (1)
pp.6-8; Journal of Forensic
Vocationology, Vol. 2(1) pp. 103-104 & JOFV, Vols 7 & 8(1),
pp. 174 & 171].
For more information on the latest revised MVQS 2005.02, 6th
Edition or Volcano 5.02 Programs, contact: Dr. Billy J.
McCroskey, Vocationology, Inc., 8209 Halifax Court North, Brooklyn Park, MN,
55443-2538. Ph: 763-569-0680. E-mail: bjmccroskey@juno.com.