MVQS Year 2005 Technical Update Relative to Frye & Daubert Standards

The McCroskey Vocational Quotient System (MVQS 2005.02) consists of three primary components: the McCroskey Dictionary of Occupational Titles (McDOT), the McCroskey TestPlot (McPLOT) and the McCroskey Transferable Skills Program (MTSP). MVQS programs stem from the MVQS McDOT, McPLOT and MTSP Program Series [(4th Edition Versions 6.2-8.0R, (McCroskey, 1992-99), 5th Edition Versions 2000 & 2001, (McCroskey, 2000, 2001) and 6th Edition, Upgraded, Updated and Revised, Versions 6.0-2005.02 (McCroskey, 2005)]. Predecessors to MVQS were DataMaster Programs (Vers. 1-4P; 1982-91)]. All three components have been seamlessly integrated into the MVQS Volcano 3.0 - 5.02 Supplemental Program Series (McCroskey, 2003-05).

 

MVQS Programs and their predecessors have been widely used and accepted for their helpfulness in determining individual employability and earning capacity in the US and Canada. To date, these programs have been used by Vocational Experts, Rehabilitation Counselors, Vocational Evaluators, College Counselors, Rehabilitation Economists, Earning Analysts, and related professionals, in more than 45 US States and Canadian Provinces. MVQS Programs are underpinned by the Minnesota Theory of Work Adjustment and the Vocational Diagnosis and Assessment of Residual Employability (VDARE, McCroskey, 1979) and standardized methods, procedures and instrumentation. They have long since met the Frye Test of General Acceptance (Frye v. US, 293 F. 1013, 1923) in Scientific Vocational Rehabilitation and Related Communities.

 

In addition to wide spread usage, on-going peer-reviewed, published, research has firmly established strong scientific reliability and validity for the MVQS Transferable Skills Analysis paradigm (Grimley, et. al., 2000a, 2000b; Dunn, Williams & Bast, 2003, 2005) and Pre/Post Earning Capacity Range Estimation algorithms (JOFV, Vols. 1-8). MVQS Programs meet the application of key standards discussed in the 1993 US Supreme Court Daubert decision (Daubert v. Merrill Dow Pharmaceuticals, Inc., 113 S. Ct. 2786, 1993; Standards re-affirmed in: Kumho Tire Co. v Carmichael (97-1709) 131 F.3d 1433, reversed, S. Ct., 1998, & Kinneman v. Ford Motor (2001). The key Daubert Standards, which apply equally to scientific, technical and other specialized knowledge, and a brief synopsis of how MVQS Programs meets each, are briefly discussed below:

 

1.      Tested theories, methods, procedures & instrumentation used by experts. MVQS programs are used in more than 45 US States and backed by peer-reviewed, published, VI research, with independent replication and predictive validity generalization cross validation studies with more than 50 published Predictive Validity Coefficients in the Very High to Extremely High range. Additional Cross validation research studies on many states have been completed on MTSP Programs. Predictive Validity Coefficients have consistently been reported to be in the Very High to Extremely High range with reasonable Standard Errors of Estimate (SEE).

2        Peer reviewed publication of theories, methods, procedures and instrumentation. Peer-reviewed in all three Job-Person Matching System Comparison Monographs. Scientific research generated includes several doctoral dissertations and masters theses. Presentations have been made at numerous national and state professional-level conferences (e.g., ABVE - Spring 2000, CALNARRP - Fall 2000, MARP - Fall 2000, CARP - Ontario, Canada, Fall 2001, ABVE - Fall 2002, and IARP - Fall 2003). Databases have been independently reviewed and studied. Scientific research articles and independent replication studies have been published in books, manuals, monographs and peer-reviewed journals. Publications include multiple Volumes/Issues and Monographs of: The Vocationologist, The Journal of Vocationology (JOV). The ABVE Journal of Forensic Vocational Assessment (JFVA, 2001). The Journal of Forensic Vocationology (JOFV 2000, 2004). The American Rehabilitation Economic Association (AREA) Monograph #1. The American Board of Vocational Experts (ABVE) Monograph #1. The ABVE Vocational Expert. The Earnings Analyst (TEA) Journal of the American Rehabilitation Economic Association), The International Association of Rehabilitation Providers (IARP) Fall Conference Proceedings: Comparing Job-Person Matching Systems CD-ROM, 2003. And, The ABVE Journal (JFVA, Vol. 8 Issue 1, 2005).

3        Known error rates (frequency of erroneous results). For MTSP 8.0R, the Predictive Validity Coefficient for using the VQ to predict earning capacity were established relative to Job Service Work Order Openings to be extremely high with Rxy=0.91, R2=0.83, SEE = $0.50/hr [McCroskey & Hahn (1998). [In: The Earnings Analyst Vol. 1(1), Spring Edition; 1998, pp. 39-80; reprinted in: Journal of Forensic Vocationology, Vol. 4(1), Spring Edition, 1998, pp. 11-52]. Other studies (McCroskey & Dennis, The Earnings Analyst Vol. 2(1), Spring, 1999) and Dennis & McCroskey, (the Journal of Forensic Vocationology, Vol. 5(1), Spring, 1999), have explored reliability, validity and standard errors of estimate rates of MTSP earning capacity predictions relative to Occupational Unit Classification Code (OUC Code) OES wages. Authors reported very high validity & relatively small standard errors of estimate (Rxy=0.68, R2=0.46, SEE = $1.01/hr). Mayer (1999), [Journal of Forensic Vocational Assessment, Vol 1(3), Spring 1999], completed a follow-up study of N=132 randomly selected, successfully re-employed 1993 Indiana State Rehabilitation Counselor Services Recipients. Mayer provided additional insight through her empirical cross validation research study demonstrating strong predictive validity and reasonable error rates for the MTSP 7.11R program, relative to known starting wage at placement outcomes. Dr. Mayer found MTSP post-injury starting earning capacity range estimates accurate within + or - 1 SEE ($1.31/hr) when compared to actual wage-at-placement outcomes. Replication studies using MTSP 8.0R & MTSP 2001 had similar findings (Dennis, 1999, Dennis & McCroskey, 2001). The Grimley, Williams, Hahn & Dennis MTSP TSA study [JOFV Vol. 6(1), 2000a, JFVA, 2000b] found very high TSA validity. McCroskey, Hahn & Dennis [JOFV, Vol. 6(1), 2000], using the Occupational Employment Statistics (OES) 92% sample of US worker wages, reported Rxy Coefficients (for Mean, 10th, 25th, 50th, 75th and 90th Percentile Wage Estimates) of Rxy=0.970, 0.973, 0.975, 0.974, 0.972 and 0.966, respectively. Standard Errors of Estimate measures, reported by the authors for the Mean, 10th, 25th, 50th, 75th and 90th Percentile Wage Estimates were: SEE=$1.19, $0.45, $0.69 $1.08, $1.65 and $2.66 per hour, respectively. These studies laid scientific foundation for the reliability & validity of the MVQS 2002-2005.02 and Volcano 4.1-5.02 TSA methodology (Rxy=0.48-0.96; SEE=6.7%) and the MVQS 2002-2005.02 curvilinear 6-point Pre/Post Earning Capacity Range Estimation methodology (See Tables 4 & 4a, JOFV Vol. 7(1) p. 174 & Vol. 8(1), p. 171).

4        The existence and maintenance of Standards. From 1981 to 2005, Technical Program Manuals on MVQS Theory, Methods & Instrumentation have been published and in peer-reviewed publications [e.g., Journal of Vocationology, Vol. 1 (1) pp.6-8; Journal of Forensic Vocationology, Vol. 2(1) pp. 103-104 & JOFV, Vols 7 & 8(1), pp. 174 & 171].

 

For more information on the latest revised MVQS 2005.02, 6th Edition or Volcano 5.02 Programs, contact: Dr. Billy J. McCroskey, Vocationology, Inc., 8209 Halifax Court North, Brooklyn Park, MN, 55443-2538. Ph: 763-569-0680. E-mail: bjmccroskey@juno.com.