April 18, 2002
Vita
Ph.D. Student Phone: (217) 333-9631 / (217) 333-2739
Industrial / Organizational Psychology e-mail: sstark@s.psych.uiuc.edu
Birthdate:
Birthplace:
Phone: (217) 337-0389
Ph.D. I/O
Psychology
A.M. I/O Psychology
B.S. Physics
·
Ph.D.;
major: Industrial/Organizational Psychology, minor: Quantitative
Psychology;
·
A.M.;
major: Industrial/Organizational Psychology;
· Transferred; non-matriculated graduate study; Psychology; Louisiana State University, Baton Rouge, LA; dates attended: Fall 1994 Spring 1996; transferred from University of New Orleans.
·
Post-Baccalaureate study; Physics / Pre-medical;
·
B.S.;
major: Physics;
Current research is in the area of psychometrics with applications in industrial/organizational, personality, and educational psychology. Specific projects include:
A. Exploring the fit of ideal point IRT models to personality data. Previous research suggested that traditional logistic models do not fit some personality scales well. Investigations are under way to explore the fit of various unidimensional ideal point item response theory (IRT) models to single-stimulus and paired-comparison personality data (Stark, Chernyshenko, Lee, & Drasgow, 2000).
B. Faking on personality measures. Development of a fake-resistant personality inventory and IRT-based scoring procedure. Research involving the Armys Assessment of Individual Motivation (AIM) inventory has suggested that administering pairs of pairs of personality descriptors involving different dimensions (e.g., conscientiousness and extraversion), which are similar in terms of social desirability, substantially reduces dissimulation. It has been suggested also that IRT-based scoring will be more accurate than classical test theory (CTT) methods that rely on heuristics. Thus, for my dissertation, I am developing a new IRT model, called GGUM-MU, that can be used to score response data obtained using a fake-resistant paired-comparison format. GGUM-MU is an extension of the Generalized Graded Unfolding Model for single stimulus responses (Roberts, Donoghue, & Laughlin, 2000).
C. Examining the effects of differential item/test functioning (DIF/DTF) on selection decisions: When do statistically significant effects become practically important? A common criticism of statistically significant DIF/DTF findings is that they may lack practical significance. Moreover, because items and tests may exhibit DIF/DTF in unexpected directions, and for reasons that are not apparent, questions are often raised concerning the usefulness of DIF/DTF results for improving test construction and selection, particularly when the cost of writing new items is substantial. This research examines the combined effects of DIF/DTF and impact (mean differences on the attribute measured across groups) on educational and employment selection decisions. The probability of being selected from a particular applicant group is studied under various combinations of DTF and impact using two approaches, and guidelines are provided for practitioners (Stark, Chernyshenko, & Drasgow, in progress).
D. Examining
the effects of dependence on IRT parameter estimation and scoring in a
computer-based testing environment.
The American Institute of Certified Public Accountants (AICPA) is
currently developing a new computerized exam for professional licensure in
accounting. Toward that end,
E. Prediction of attrition among Army recruits. The US Army is interested in using personality scores to prediction attrition among recruits. Data from the Assessment of Individual Motivation (AIM) inventory are currently being examined by researchers using CTT and IRT-based approaches. My role in this project involves the prediction of attrition using IRT optimal appropriateness measurement methods (see Levine & Drasgow, 1988).
F. A
comparison of Likert and Thurstonian approaches to the construction of scales measuring
job satisfaction: Application of an ideal point item response theory model. This research is being conducted in
collaboration with Oleksandr Chernyshenko, Wayne Lee, and Fritz Drasgow at the
G. Detection of DIF under different conditions of model-data fit. This investigation will determine how critical the choice of an appropriate IRT model is to the accurate detection of DIF. Previous research suggests that selecting a model that does not fit experimental data well can lead to incorrect conclusions regarding test bias, or in the context of personality measurement, the presence of faking among job applicants. Parametric and nonparametric DIF detection procedures will be compared for logistic and ideal point models.
Fall 1999 Spring 2000: Industrial / Organizational Psychology (Instructor)
(
Spring 1997 - Spring 1998: Introduction to Social Psychology (Teaching Assistant/Lecturer)
(
Fall 1996: Industrial Social Psychology (Teaching Assistant)
(
Spring 1991- Summer 1991: Physics Laboratories for Science/Engineering & Pre-Medical/Dental Students
(
Appointments and Other Employment
Fall 2001 Spring 2002: University Dissertation Fellowship. Continue research on development and scoring of a fake-resistant format for administering personality items.
Explore IRT-based scoring of responses to computer simulation tasks, similar to those that will appear on the new computerized Certified Professional Accountants (CPA) licensing exam.
Summer 2001: Internship: American
Fall 2000 Summer 2001: Research assistant for Fritz Drasgow, Department of Psychology. Developed IRT-based, optimal appropriateness measurement approach to identify examinees that were unmotivated on some sections of the CPA licensing exam; compared psychometric properties of the 1998 exam before and after removing unmotivated examinees.
Conducted differential item/test functioning study to identify CPA exam items and subtests that exhibited measurement bias against ethnic, gender, and educational groups.
Consortium
Research Fellows Program, Army Research Institute (ARI). Conducted psychometric evaluation of
Assessment of Individual Motivation inventory; used optimal appropriateness
measurement methods to predict attrition among recruits; mentored by Fritz
Drasgow,
Fall 1999 Spring 2000: Instructor for Industrial Organizational Psychology.
Psychometric consultant for evaluation of CPA licensing examination; project co-headed by Fritz Drasgow, Department of Psychology.
Fall 1998 Summer 1999: Research assistant for Terry Ackerman, Department of Educational Psychology; developed computer simulations involving multidimensional item response theory; provided psychometric and statistical consulting for Medical College of Wisconsin.
Fall 1998 Spring 1999: Research assistant for sexual experiences lab; developed computer programs, applied item response theory to measure sexual harassment; principal investigators: Fritz Drasgow, Charles Hulin, and Louise Fitzgerald, Department of Psychology.
Summer 1998 Summer 1999: Psychometrics consultant for Personnel Decisions Research Institute; developed computer adaptive test of job performance and parameter estimation procedures for paired comparison ideal point IRT model; supervised by Fritz Drasgow, University of Illinois at Urbana-Champaign; Walter C. Borman, and Mary Ann Hanson, Personnel Decision Research Institutes, Inc., University of South Florida.
Summer 1997, 1998: Research assistant for Lloyd G. Humphreys, Department of Psychology; conducted individual differences research on cognitive ability using Project Talent and National Longitudinal Survey of Youth data.
Spring 1997 Spring 1998: Teaching assistant/lecturer for Introduction to Social Psychology; supervised by Peter Carnevale and James Davis.
Fall 1996: Teaching assistant for Industrial Social Psychology; supervised by Harry C. Triandis.
Research assistant for Lloyd G. Humphreys, Department of Psychology.
Summer 1994 Fall 1995: Student worker, assisted in alcohol research through Louisiana State University Medical Center, Department of Internal Medicine, Earl K. Long Hospital, Baton Rouge, LA; principal investigator: Frederick Cerise, MD.
Spring 1992 Fall 1992: Instructor for physics laboratory courses for science/engineering and pre-medical students; supervised by Clyde Bergeron and J. Sullivan, Department of Physics.
Society of Industrial and Organizational Psychology Student Affiliate
National Council on Measurement in Education Student Affiliate
Phi Kappa Phi National Honor Society 1991 present
Alpha Theta Epsilon Honor Society 1986 1987
University
Honors Council (
National Deans List 1991
UIUC Dissertation Fellowship 50% Stipend 2001 2002
ARI Consortium Research Fellowship 25% Stipend 2000 2001
AICPA Psychometrics Internship $5000 Stipend Summer 2001
[1]IPAT Student Research Competition Cash Award 2000
Incomplete List of Excellent Teachers Psychology 1997 1998
Physics Faculty Awards Physics excellence 1990 1991
Max Herzberger Scholarship Physics excellence 1989 1990
Junior Division Award Outstanding GPA 1987
Decennial Honors Scholarship Tuition & Expenses 1985 1988
Co-valedictorian 1985
Torch Awards Top 5 GPA in cohort 1982 1985
2000
Humphreys, L.G., & Stark, S.
(2000). Implications for social policies
and a genetic contribution to individual differences in intelligence (pp. 773 - 774).
In W.E. Craighead & C.B. Nemeroff (Eds.).
The Corsini Encyclopedia of Psychology and Behavioral Science (Third
Ed., Vol. 2).
Humphreys, L.G., & Stark, S.
(in press). The general factor among
cognitive tasks, its measurement, its correlates, and its cultural-genetic
substrate. In R. J. Sternberg & E.
L. Grigorenko (Eds.).
The general factor of intelligence: Fact or fiction?
2001
Stark, S., Chernyshenko, O.S., Chan, K.Y., & Lee, W.C. (2001). Effects of the Testing Situation on Item Responding: Cause for Concern. Journal of Applied Psychology, 86, 943 - 953.
Borman, W.C., Buck, D., Hanson, M.A., Motowidlo, S.J., Stark, S., & Drasgow, F. (2001). An examination of the comparative reliability, validity, and accuracy of performance ratings made using computerized adaptive rating scales. Journal of Applied Psychology, 86, 965 - 973.
Chernyshenko, O.S., Stark, Chan, K.Y., Drasgow, F., & Williams, B.A. (2001). Examining the factor structure of the 16PF Fifth Edition: An application of the Schmid-Leiman orthogonalization procedure. Educational and Psychological Measurement, 61, 290 - 302.
Chernyshenko, O.S., Stark, S.,
Chan, K.Y., Drasgow, F., & Williams, B.A. (2001). Fitting Item Response Theory models to two
personality inventories: Issues and insights. Multivariate Behavioral
Research, 36, 523 -
562.
2002
Stark, S., Chernyshenko, O.S., Lancaster, A.R., Drasgow, F., & Fitzgerald, L. F. (2002). Toward standardized measurement of sexual harassment: Shortening the SEQ-DoD using item response theory. Military Psychology, 49 72.
In Press
Stark, S., & Drasgow, F. (June 2002). An EM approach to parameter estimation for the Zinnes and Griggs paired comparison IRT model. Applied Psychological Measurement.
Stark, S., Chernyshenko, O.S., & Drasgow, F. (in review).
Identifying and understanding the effects of unmotivated examinees on
test dimensionality: Application of optimal appropriateness measurement. Journal of Educational Measurement.
Stark, S., Chernyshenko, O.S., & Drasgow, F. (in review).
Investigating the appropriateness of ideal point response processes for
personality data: Implications for scale
development and use. Journal of
Personality and Social Psychology.
Stark, S., Chernyshenko, O.S., & Drasgow, F. Investigating the effects of local
dependence on the accuracy of IRT ability estimation. Applied Psychological Measurement.
Stark, S., Chernyshenko, O.S., & Drasgow,
F. Examining the effects of differential item/test functioning (DIF/DTF)
on selection decisions: When are
statistically significant effects practically important? Journal of Applied Psychology.
Roberts, B., Chernyshenko, O.S., & Stark, S. The construct of conscientiousness: The
convergence between lexical models and scales drawn from six major personality
questionnaires. Personnel Psychology.
1997
Chan, K., Chernyshenko, O.S., &
Stark, S. (Fall 1997). Factor analysis of the fifth edition of
the 16PF.
1998
Chan, K., Chernyshenko, O.S., &
Stark, S. (Spring 1998). Psychometric evaluation of the fifth
edition of the 16PF: IRT analysis.
1999
Stark, S., Chernyshenko, O.S., & Drasgow, F. (1999). Shortening the Sexual Experiences Questionnaire - Department of Defense (SEQ-DoD) using item response theory: Report on the measurement of sexual harassment.
2000
Drasgow, F., Chernyshenko, O.S., Stark, S., Munson, L., & Wang,
J. (Fall, 2000). Classical test theory and item response
theory analysis of the AICPA exam.
Drasgow, F., Chernyshenko, O.S., & Stark, S. (Spring, 2001). Differential item functioning analysis of
the AICPA exam.
2001
Stark, S., Chernyshenko, O.S., & Drasgow, F. (Spring, 2001). Identification of unmotivated examinees on
the CPA exam using optimal appropriateness measurement: Assessment of the CPA
exam.
Drasgow, F., Lee, W. C., Stark, S., & Chernyshenko, O.S. (Spring, 2001). Alternative methodologies for predicting
attrition in the Army: The new AIM scales.
(Report to HUMMRO).
1998
Stark, S. & Drasgow, F. (1998).
Application of an item response theory ideal point model to computer
adaptive assessment of job performance.
Paper presented at the 13th annual conference for the Society
of Industrial and Organizational Psychologists.
1999
Stark, S., Chan, K.Y.,
Chernyshenko, O.S., & Lee, W.C.
(1999). Faking on personality
measures: Is it an attribute of the person or the situation? Paper presented at the 14th annual
conference for the Society of Industrial and Organizational Psychologists.
Stark, S. Chernyshenko, O.S., &
Drasgow, F. (November, 1999). Shortening the Sexual Experiences
Questionnaire Department of Defense (DoD) using item response theory: Report
on the measurement of sexual harassment.
Conference proceedings of the 41st annual conference of the
International Military Testing Association (IMTA) / Officer Selection
Workshop.
Chernyshenko, O.S., Chan, K.Y.,
Stark, S., Drasgow, F., & Williams, B.A.
(1999). Examining the fit of
item response theory models to personality data. Paper presented at the 14th annual
conference for the Society of Industrial and Organizational Psychologists.
2000
Stark, S., & Drasgow, F.
(April, 2000). Development of
parameter estimation procedures for the Zinnes and Griggs paired comparison
ideal point IRT model. Paper
presented at the 2000 Annual Meeting of the National Council on Measurement in
Education.
Stark, S., Chernyshenko, O.S., Lee,
W.C. & Drasgow, F. (2000).
New insights in personality measurement: Application of an ideal
point IRT model. Paper presented at
the 15th annual conference for the Society of Industrial and
Organizational Psychologists.
Chernyshenko, O.S., Miner, A., & Stark, S. (2000). Computational modeling of the effects of cue repetition on individual and group judgment
.
Paper presented at the 15th annual conference for the Society
of Industrial and Organizational Psychologists.
Fitzgerald, L.F., Stark, S.,
Chernyshenko, O.S., Palmieri, P.A., Harned, M., Collinsworth, L.L.,
& Drasgow, F. (2000). Who counts? A rational-empirical algorithm
for determining the incidence of sexual harassment in organizations. Paper presented at the 15th annual
conference for the Society of Industrial and Organizational Psychologists.
Miner, A., Chernyshenko, O.S.,
& Stark, S. (2000). A dynamic computational model of cue
weighting during group discussion.
Paper presented at the 15th annual conference for the Society
of Industrial and Organizational Psychologists.
2001
Stark, S., Chernyshenko, O.S.,
& Drasgow, F. (2001). Identifying unmotivated examinees using
optimal appropriateness measurement: Assessment of the CPA exam. Paper presented at the 2001 Annual Meeting of
the American Educational Research Association.
Stark, S., & Chernyshenko,
O.S. (2001). Examining Model-data Fit Using Graphical
and Statistical Methods. Paper
presented at the 16th annual conference for the Society of
Industrial and Organizational Psychologists.
Stark, S., & Chernyshenko,
O.S. (2001). Methods for Detecting Differential
Item/Test Functioning. Paper
presented at the 16th annual conference for the Society of
Industrial and Organizational Psychologists.
Chernyshenko, O.S., & Stark,
S. (2001). Using IRT methods for test construction:
Creating parallel forms. Paper
presented at the 16th annual conference for the Society of
Industrial and Organizational Psychologists.
Lee, W.C., Stark, S., &
Chernyshenko, O.S. (2001). Selecting IRT models for cognitive and
noncognitive data. Paper presented
at the 16th annual conference for the Society of Industrial and
Organizational Psychologists.
Stark, S., Chernyshenko, O.S., & Drasgow, F. (April, 2002). Investigating the effects of local
dependence on the accuracy of IRT ability estimation. Paper presented at the 2002 Annual Meeting of
the National Council on Measurement in Education.
Stark, S., Chernyshenko, O.S., & Drasgow,
F. (April, 2002). Examining the effects of differential item/test functioning (DIF/DTF)
on selection decisions: When are statistically
significant effects practically important? Paper presented at the
17th annual conference for the Society of Industrial and
Organizational Psychologists.
Fritz Drasgow, Professor of I/O Psychology, Labor
and Industrial Relations, Dissertation Chair
Department of Psychology
(217) 333-2739
Charles L. Hulin, Professor of I/O Psychology
(Emeritus)
Department of Psychology
(217) 333-3798
Terry Ackerman, Professor of Educational Research
Methodology
207 Curry Building
(336) 334-3474
Lloyd G. Humphreys, Professor of Education and
Psychology (Emeritus)
Department of Psychology
(217) 346-3571 (home)
Department of Psychology
BEH 339
(813) 974-2492
or
Personnel Decision Research Institute
(813) 229-6646
Timothy Buckley, Ph.D. I/O Psychology, Former
Advisor at
US Employment Service
Office of Personnel Management
1900 E. Street, N.W.
(202) 606-1935
(202) 606-1399 (fax)
[1] Second
place cash award in International Personality and Ability Testing (IPAT)
Student Research Competition. Paper
submitted by Stark, S., Chernyshenko, O. S., Chan, K.Y., & Lee, W.C. (1999).
Faking on personality measures.
Is it an attribute of the person or the situation? Paper was presented at the 14th
annual conference for the Society of Industrial and Organizational
Psychology.