HR/OB Research Design Simulation 2.0

Stage 1 — Topic Choice Under Constraint

Pick one topic. Imagine you have limited time and access while still wanting a non-trivial contribution. Each topic tilts you toward different strengths and weaknesses.

AI-enabled performance monitoring and employee anxiety

Real-time tracking tools, dashboards and nudges in knowledge work.

+ Strong current relevance + Clear link to JD-R / control theories - Concept boundary confusion - Risk of oversimplifying complex systems

Hybrid work patterns and leader–member exchange

Asymmetric office/remote presence and perceived relationship quality.

+ Accessible field sites and measures + Familiar constructs for reviewers - Risk of incremental "yet another hybrid" paper - Hard to claim novelty without subtle gap

Gig workers' psychological contract and citizenship

Freelancers and platform workers navigating expectations and extra-role behaviors.

+ High novelty and societal importance + Potential for cross-disciplinary impact - Access and sampling challenges - Ethical sensitivity and attrition risks

HR analytics capability and line managers' decisions

Data-driven HR tools enabling or constraining managerial judgement.

+ Attractive to practitioners and HR heads + Opportunity to integrate IT and HR literatures - Abstract constructs, risk of vague measures - Causal ordering not straightforward

Write one sentence: why you chose this topic over the others.

Stage 2 — Literature Strategy and Gap

You have limited weeks before a conference deadline. You must choose how deeply and broadly to read, and how sharply to define your gap.

Broad & historical sweep

You read across disciplines and decades to map the terrain.

+ Rich conceptualisation + Greater chance of finding non-obvious gaps - Time intensive, risk of diffusion - Harder to communicate concise story

Focused & journal-centric

You mainly read last 10 years in a few target journals.

+ Clear positioning within known conversations + Easier to design study that "fits" - May miss cross-disciplinary insights - Gap can become incremental

Theory-driven targeting

You anchor on one core theory and hunt related empirical work.

+ Strong conceptual coherence + Clear hypotheses and boundary conditions - Risk of theory monoculture - May underplay alternative explanations

Now choose how you frame your gap. Ambitious gaps raise the bar for methods and analysis later.

Careful extension

"We extend existing theory X into context Y with added mechanism Z."

+ Safer, reviewers know what to expect + Easier to justify design choices - Contribution may feel incremental - Tough to stand out in top journals

Subtle challenge

"We problematise a widely held assumption under specific conditions."

+ Potentially high theoretical payoff + Engages reviewers intellectually - Requires strong design and argumentation - Reviewers can become defensive

Integration of two streams

"We bridge two literatures that rarely speak to each other."

+ Distinctive and intellectually satisfying + Room for novel constructs or frameworks - Complex to execute and communicate - Risk of reviewers from both sides being unconvinced

Stage 3 — Methodology and Design

You now face access, time and ethics constraints. You cannot have the ideal design on all dimensions.

Multi-firm cross-sectional survey

Employees across several organisations complete validated scales.

+ Feasible within one semester + Easy to link to existing measures - Causality and common method concerns - Reviewers may push for stronger design

Multi-source, multi-wave field study

Data from employees, managers and systems at two time points.

+ High rigor and credibility + Better suited to ambitious gaps - Access and attrition challenges - Project management load is heavy

Scenario-based experiment

Managers/workers respond to manipulated HR scenarios.

+ Strong internal validity + Clear link to causal claims - External realism concerns - May feel detached from practice

Choose a sampling and measurement strategy. Each shifts feasibility and rigor.

Single large firm, mostly self-report

Deep access in one organisation, rich contextual detail.

+ Easier negotiation and implementation + Strong contextual insight - Limited generalisability - Common method bias risk

Multiple firms in one industry, mixed measures

Surveys plus selected objective indicators.

+ Balanced rigor and feasibility + Stronger external validity than single firm - Negotiating access takes time - Data quality can be uneven

Multiple industries, mainly validated scales

Broad sampling frame with standardised instruments.

+ Strong generalisability + Easier to recruit via online panels - Less control over context - Harder to include objective measures

Stage 4 — Analysis Strategy

You now decide how ambitious your modelling will be. Overcomplicated models on fragile data can backfire.

Regression with mediation

Straightforward paths, clear robustness checks.

+ Transparent and teachable + Less sensitive to sample limitations - May under-sell rich designs - Some reviewers prefer more sophistication

Structural equation modelling

Latent constructs, multiple indirect paths.

+ Strong alignment with theory-driven gaps + Allows complex testing - Requires large samples and quality measurement - Reviewers may scrutinise model fit and decisions

Multilevel modelling

Cross-level effects and variance partitioning.

+ Powerful for nested data + Attractive when levels-of-analysis are central - Needs adequate clusters and careful interpretation - Some reviewers may be conservative

How complex will you go with interactions, controls and alternative models?

Parsimonious modelling

Few controls, targeted tests, clear narrative.

+ Easier to communicate and defend + Less risk of overfitting - Reviewers may ask "what about X and Y?" - Perceived as less exhaustive

Rich modelling

Multiple interactions, controls and alternatives.

+ Demonstrates analytic ambition + Can pre-empt some reviewer concerns - Greater risk of fragile or confusing results - Write-up becomes heavier

Stage 5 — Discussion, Implications and Limitations

Assume your results are broadly supportive but not perfect. Your framing can either build trust or trigger scepticism.

Bold theoretical story

You emphasise reconceptualisation and strong claims.

+ Potentially memorable contribution + Signals confidence and vision - High risk if methods are not bulletproof - Reviewers may push back hard

Balanced theory–practice framing

You clearly state theoretical gains and practical implications.

+ Often well-received across reviewers + Connects to both academic and practitioner audiences - Requires discipline to avoid vague recommendations - Less "flashy" than bold reconceptualisation

Cautious and boundary-aware

You emphasise conditions, limitations and future research.

+ Builds trust in your judgement + Positions you as careful scholar - Contribution may feel modest - Practical audience may be less engaged

How prominently will you discuss limitations?

Minimal limitations paragraph

One clean paragraph, focused on obvious issues.

Dedicated limitations section

2–3 key boundaries and threats to validity.

Strong limitations and cautious tone

You actively temper claims and highlight future work.

Imaginary Review Panel Outcome

Reflection prompts for you and your partner:

Which single early decision (topic, LR, gap, design) most constrained your later options?
Where did you trade off ideal rigor for feasibility — was it worth it?
Did your discussion tone match the actual strength of your evidence?
How does this simulated path compare to what you are planning for your PhD research?

HR/OB Research Simulation 2.0