6. Psychological Assessment

Introduction

Psychological assessment is the systematic collection and interpretation of information about psychological characteristics. It may use tests, interviews, observations and records depending on the purpose.

The heart of this topic is not memorizing test names. It is understanding what makes a measure trustworthy and how assessment should be used ethically.

Source-Aligned Core Concepts

• Reliability: Reliability concerns consistency of measurement. If a measure is intended to assess a stable characteristic, its results should not vary wildly because of avoidable measurement error.
• Validity: Validity concerns the evidence supporting the interpretation and use of scores for a particular purpose. A measure can be consistent but still unsuitable for the conclusion a user wants to draw.
• Item analysis: Item analysis examines how individual questions perform, for example whether they are too easy, too difficult, or useful for distinguishing among examinees. The exact statistics matter less at introductory level than the purpose.
• Norms: Norms help interpret a score by comparing it with an appropriate reference group. A raw score alone may be difficult to understand without context.
• Modern test theory: Modern approaches model the relationship between a person’s underlying trait and responses to test items. For a crash course, understand the idea and purpose rather than advanced mathematics.
• Applications: Assessment may support selection and training, educational decisions, clinical formulation and other professional purposes. The tool must fit the purpose and population.
• Ethical and legal issues: Competence, informed consent where applicable, confidentiality, fair use, non-discrimination and careful interpretation are central. Decisions should not be based blindly on a single score.

Expanded Master Explanation

The following sections develop the compressed source notes into the academic depth needed for first-time understanding and analytical answer writing.

Assessment is a decision process, not merely a test score

A psychological test is one possible instrument within a broader assessment. Assessment begins with a referral question or decision problem, selects appropriate methods, gathers data, interprets results in context and communicates conclusions with stated limits. A score has meaning only in relation to the construct, population, norms, testing conditions and intended use.

• Standardization: Standardization means administering and scoring a measure under consistent procedures so that differences in scores are less likely to reflect arbitrary differences in testing conditions.
• Norms: Norm-referenced interpretation compares an examinee with an appropriate reference group. Norms can become outdated or inappropriate when the tested population differs substantially from the standardization sample.
• Criterion reference: Some assessments interpret performance against a defined standard or competency rather than against other people. The distinction matters because the same raw score can carry different meanings under different interpretive frameworks.

Reliability: how consistent is the measurement?

• Test-retest reliability: Examines stability of scores across time when the underlying attribute is expected to remain relatively stable. Low stability may reflect measurement error, real change or both.
• Internal consistency: Examines how coherently a set of items measures related content. Very high internal consistency is not automatically desirable if it results from redundant items and overly narrow content.
• Inter-rater reliability: Important when human judgment is involved. Clear scoring criteria, training and calibration can reduce inconsistent ratings.
• Standard error of measurement: Observed scores contain measurement error. The standard error reminds users that a score should not be treated as perfectly precise and supports interpretation as a range rather than an exact statement of ability.

Validity: what interpretations and uses are supported?

• Content evidence: Asks whether assessment content adequately represents the domain it is intended to cover.
• Relations with other variables: Scores should relate to relevant external criteria or constructs in theoretically expected ways. Predictive and concurrent evidence are examples.
• Internal structure: Factor-analytic and related evidence can test whether item relationships are consistent with the proposed construct structure.
• Consequences and fairness: Good assessment practice also examines whether interpretations operate fairly across groups and whether foreseeable consequences of use are acceptable. Reliability is necessary for many interpretations but is not sufficient for validity.

Item analysis and modern test theory

• Item difficulty: In achievement testing, difficulty often refers to the proportion answering an item correctly. An item that everyone answers correctly may be useful for mastery testing but offers little discrimination among high and low performers.
• Item discrimination: Discrimination asks whether an item differentiates examinees in a way consistent with the test's purpose. Poorly worded or ambiguous items can behave unpredictably.
• Classical test theory: Classical test theory separates observed score conceptually into true-score and error components. Its statistics depend partly on the sample and test.
• Item response theory: IRT models the probability of item responses as a function of an underlying trait and item characteristics. It supports sophisticated test development and adaptive testing but requires stronger statistical assumptions and larger data sets.

Ethical, cultural and legal responsibility

• Competence: Users should understand the instrument, its evidence base and the population for which it was designed. Possessing a test form is not equivalent to professional competence.
• Informed participation: Where relevant, examinees should understand the purpose, expected use of results and limits of confidentiality. Requirements vary by setting and law.
• Bias and fairness: Language, disability, education, culture and unequal opportunity can affect performance. Fairness does not mean ignoring differences; it means checking whether the interpretation is defensible for the intended population.
• Multiple sources: High-stakes decisions should rarely depend blindly on a single score. Interviews, records, observations and other evidence can provide context and reduce overinterpretation.

Responsible assessment process

Reading the flow: each step creates the conditions for the next; the arrows show sequence or influence, not inevitability unless the text explicitly says so.

Reliability and validity compared

How to Prepare This Topic

• Write reliability and validity on separate flash cards with one example each.
• Practise explaining why a test can be reliable but not valid for a specific purpose.
• Make the assessment flow: purpose → choose method → administer → score → interpret → communicate/decide.
• Add an ethics box to every assessment answer.

Common Confusion / Mistake

How to Build an Examination Answer

Define assessment, explain the qualities of good measures, discuss item analysis/norms and applications, then finish with ethical and legal safeguards.

Evidence and Source Notes

Key Takeaways

30-Second Self-Check

• □ Can I explain psychological assessment in my own words without notes?
• □ Can I make at least one correct comparison, diagram, framework or example from this topic?
• □ Can I turn this topic into a clear introduction + 4–6 headings + conclusion in under five minutes?