Scholarship

Publications

Research spans personnel assessment, AI in selection, job analysis, and research methodology.

Review experience: Journal of Organizational Behavior; Society for Industrial and Organizational Psychology

Peer-Reviewed Publications

(4)Published

Rolwes, P., Martín-Raugh, M. P., Smith, K., & Gallegos, E. (2025).

The paradox of research novelty: Balancing innovation with practical impact in industrial and organizational psychology.

Industrial and Organizational Psychology, 18(2), 206–210.

DOI ↗

Gallegos, E., Smith, K. M., Rolwes, P., & Martín-Raugh, M. P. (2025).

Exploring the intersection of culturally responsive principles and moral framing in DEI training.

Industrial and Organizational Psychology, 18(2), 257–260.

DOI ↗

Barron, L. G., Rolwes, P. J., & Rose, M. R. (2022).

Validation and refinement of the "Airman Comprehensive Assessment": Evaluating competency proficiencies of enlisted members.

Military Psychology, 36(1), 16–32.

DOI ↗

Rolwes, P., Cox, C., & Pool, G. J. (2021).

Who is called to work? The importance of calling when considering universal basic income.

Industrial and Organizational Psychology, 14(4), 582–585.

DOI ↗

Manuscripts Under Review

(6)Under Review

Revise and Resubmit

Rolwes, P. J., Courey, K. A., Oswald, F. L., & Martín-Raugh, M. P..

Advancing adverse impact analysis: Permutation testing and Bayesian methods for small sample challenges.

Organizational Research Methods.

Revise and Resubmit

Rolwes, P. J., Martín-Raugh, M. P., Himelfarb, I., & Solecki, N. R..

Gender differences in the perception of risk and the relationship between risk and task frequency.

International Journal of Occupational Safety and Ergonomics.

Under Review

Rolwes, P. J., Martín-Raugh, M. P., Gallegos, E. A., & Smith, K. M..

Temporal trends in interview validity: A meta-analytic examination of publication year as a moderator in the interview-job performance relationship.

Personnel Psychology.

Under Review

Rolwes, P. J., Voss, N. M., Brooks, R. R., Martín-Raugh, M. P., & Kell, H. J..

Comparing large language models and human raters for scoring open-ended situational judgment tests.

Journal of Business and Psychology.

Under Review

Rolwes, P. J. & Martín-Raugh, M. P..

A comparative analysis of AI-generated and subject matter expert-developed situational judgment tests: Implications for reliability, validity, and fairness.

Industrial and Organizational Psychology.

Under Review

Watts, L. L., Martín-Raugh, M. P., Rolwes, P. J., McLemore, P. B., Harwell, K. W., & Kochert, J. F..

Cognitive fixation mechanisms and creativity: An integrative review.

Creativity Research Journal.

Manuscripts in Preparation

(9)In Preparation

Courey, K. A., Rolwes, P., Oswald, F. L., & Martín-Raugh, M. P..

Practical solutions for adverse impact analysis: Leveraging permutation testing and Bayesian methods in small sample scenarios.

McAbee, S. T., Martín-Raugh, M. P., Wall, L. J., & Rolwes, P. J..

Assessing the universality of HEXACO: Exploring measurement invariance across language barriers.

Martín-Raugh, M. P., Sackett, P. R., Lievens, F., Xi, L., & Rolwes, P. J..

The good, the bad, and the generative: A meta-analysis of LLMs in SJT development, scoring, and cheating.

Rolwes, P. J., Martín-Raugh, M. P., & Himelfarb, I..

Exploratory graph analysis of job analysis networks: Insights from chiropractor data.

Gallegos, E. A., Smith, K. M., Rolwes, P. J., & Martín-Raugh, M. P..

AI-enhanced application materials: Selecting candidates or algorithms?

Seybert, J. M. & Rolwes, P. J..

Examining the impact of context and country on forced-choice scores.

Gallegos, E. A., Martín-Raugh, M. P., Smith, K. M., Brooks, R. R., Kell, H. J., & Rolwes, P. J..

Are single-response situational judgment tests less cognitively loaded than multiple-response SJTs?

Brooks, R. R., Martín-Raugh, M. P., Kell, H. J., & Rolwes, P. J..

The influence of cognitive ability on situational judgement test scores: The effects of fluid vs. crystallized intelligence.

Rolwes, P. J. & McLemore, P. B..

Who's really doing the thinking? Using think-aloud assessment to differentiate LLM-assisted and traditional candidate responses.

Book Chapters

In Press

Smith, K. M., Rolwes, P., Gallegos, E., & Martín-Raugh, M. P..

Leading with cultural responsiveness: Incorporating CRA principles to achieve organizational goals in a changing landscape.

In E. King, Q. Roberson, & M. Hebl (Eds.), Call to Action for Policymakers: Defending and Advancing Diversity, Equity, and Inclusion (DEI). Information Age Publishing.

Technical Reports

(3)

Rolwes, P., Nagle-Pinkham, D., Gonzalez, A., Cunningham, A., Kachelmeier, L., & Willis, D. (2021).

Determining the quality of occupational analysis data.

Technical Report.

Barron, A. & Rolwes, P. (2021).

Evaluation of digital literacy as an Air Force foundational competency (Vol. 3, pp. 1–26).

Technical Report.

Barron, A. & Rolwes, P. (2020).

Development of Air Force foundational competency assessments (Vol. 2).

Technical Report.

Conference Presentations

(14)

Poster

Rolwes, P. J., McCall, E., Martín-Raugh, M. P., Gallegos, E. A., & Smith, K. M. (2026).

The criterion validity of interviews across time: A meta-analysis.

Society for Industrial and Organizational Psychology Annual Conference, New Orleans, LA.

Poster

Rolwes, P. J., Martin-Raugh, M. P., & Himelfarb, I. (2026).

Exploratory graph analysis of job analysis data: Insights from chiropractor data.

Society for Industrial and Organizational Psychology Annual Conference, New Orleans, LA.

Special Session

Seybert, J., Colton, C., & Rolwes, P. J. (2026).

Community of Interest: AI gone wrong — Lessons from the trenches.

Society for Industrial and Organizational Psychology Annual Conference, New Orleans, LA.

Symposium

Rolwes, P. J. & Martin-Raugh, M. P. (2026).

A comparative analysis of AI-generated and human-developed situational judgment tests.

Society for Industrial and Organizational Psychology Annual Conference, New Orleans, LA.

Symposium

Pool, G., Crentsil, J., Fazalbhai, S., & Rolwes, P. J. (2026).

What I/O psychologists really do: Career stories from a growing field.

Southwestern Psychological Association Annual Conference, Frisco, TX.

Poster

Rolwes, P. J. & Martin-Raugh, M. (2025).

Small sample? No problem! Using permutation testing for adverse impact analysis.

Society for Industrial and Organizational Psychology Annual Conference, Denver, CO.

Poster

Cardenas, B., Rolwes, P. J., & Jordan, B. J. (2025).

How well do you know yourself? Examining the impact of humility, gratitude and forgiveness on self and other 360 ratings.

Society for Industrial and Organizational Psychology Annual Conference, Denver, CO.

Panel

Smith, K. M. (Co-Chair), Rolwes, P. (Co-Chair), Crook, A. E., Labrador, J. R., Dalal, D., Seybert, J., & Williams, B. C. (2025).

Reinvigorating job analysis for the modern workforce: Impacts of AI and other trends.

Society for Industrial and Organizational Psychology Annual Conference, Denver, CO.

Special Session

Kochert, J., Seybert, J., McLemore, P., Rolwes, P., & Tran, E. (2025).

Community of Interest: Strategic & ethical use of AI in organizations.

Society for Industrial and Organizational Psychology Annual Conference, Denver, CO.

Panel

Gertner, R. G., Williams, B. C. (Chair), Williams, K. C., Jordan, B., Nesnidol, S., & Rolwes, P. (2024).

Unlocking organizational excellence: Exploring competencies in the modern workplace.

Society for Industrial and Organizational Psychology Annual Conference, Chicago, IL.

Symposium

Nagle-Pinkham, D., Rolwes, P., Burke, S., & Huang, J. L. (2023).

An alternative outlier approach to detect insufficient effort responding.

SIOP Annual Convention, Boston, MA.

Presented by Gonzalez, A., III

Poster

Rolwes, P., Garcia, A., Sanchez, M., & Barron, L. G. (2022).

Digital literacy competencies as differentiators of career success.

SIOP Annual Conference, Seattle, WA.

Symposium

Rolwes, P. & Barron, L. G. (2021).

Defining Air Force Digital Literacy.

Military Operations Research Society Annual Convention, Virtual.

Poster

Rolwes, P. (2021).

The effects of calling in the workplace: A meta-analytic review.

SIOP Annual Convention, Virtual.