"Evaluación de (la implementación) las medidas de prevención contra el delito"

Introduction to Crime Prevention Evaluation

Overview of the Presentation

• Lucía Sumers introduces herself as a professor at Texas State University and Universidad Miguel Hernández, expressing her excitement about discussing crime prevention evaluation.

• The presentation aims to cover important objectives related to evaluating crime prevention measures, with a focus on understanding their implementation.

Importance of Evaluation in Criminology

• Emphasizes the necessity of evaluating interventions in criminology to establish it as a scientific discipline.

• Discusses the distinction between impact evaluation and process evaluation, highlighting the role of implementation assessment.

Key Concepts in Implementation Science

Acronyms and Their Utility

• Introduces acronyms like SARA, BASE, PANDA, and GOALS that are relevant for effective intervention implementation.

• Explains how these acronyms help frame discussions around intervention strategies and outcomes.

General Approach to Evaluations

• Notes that many concepts discussed are applicable beyond criminology, relevant across various disciplines dealing with interventions.

• Highlights the research process where problems are identified, solutions hypothesized, and studies conducted to test effectiveness.

Evaluating Effectiveness: A Pragmatic Approach

The Role of Pilot Studies

• Describes pilot studies as small-scale tests used to gather evidence before larger investments in interventions are made.

• Stresses the importance of evaluations in ensuring resources are allocated efficiently within law enforcement and judicial systems.

Understanding Contextual Factors

• Discusses how evaluations contribute to building an evidence base for rehabilitation programs by addressing questions about what works under specific conditions.

• Shifts from asking "What works?" to "What works for whom and under what circumstances?" emphasizing context's significance in intervention success.

The Process of Problem Solving through Evaluation

Non-linear Nature of Evaluation

• Clarifies that evaluation is part of a non-linear problem-solving process involving identification, study, solution introduction, and ongoing assessment.

Resource Efficiency Considerations

• Highlights the need for efficient resource use within limited budgets across police forces or correctional facilities when implementing solutions.

Evaluation Types and Their Importance

Key Components of Evaluations

• The discussion begins with the identification of two main types of evaluations: cost-benefit evaluations and needs assessments, both crucial for any evaluation study.

• Emphasis is placed on the importance of measuring impact, particularly in interventions aimed at solving specific problems like crime rates in neighborhoods.

Measuring Impact

• The methodology for measuring impact is highlighted as critical; it should allow researchers to determine if changes in a problem are due to the intervention.

• Typical evaluations focus on whether there has been a reduction in crime, comparing statistics before and after the intervention.

Process Evaluation vs. Impact Evaluation

• While impact evaluations yield quantitative data (e.g., percentage reductions), process evaluations often involve qualitative studies such as interviews or surveys that provide deeper insights into the intervention's mechanisms.

• Qualitative data can reveal unexpected information about how an intervention works or fails, identifying both positive and negative effects.

Understanding Mechanisms

• Researchers aim to uncover mechanisms behind interventions by asking questions that explore how they function, which may lead to discovering unforeseen outcomes.

• The complexity of interventions necessitates understanding various elements involved, helping identify which aspects were more effective than others.

Implementation Assessment

• A key question in process evaluation is whether the intervention was implemented correctly; improper implementation can invalidate impact assessments.

• If an intervention intended to reduce crime through police patrol does not occur as planned, it’s unsurprising if results show no improvement.

Consequences of Poor Implementation

• Discovering that an intervention was not executed properly during evaluation can explain why expected positive outcomes did not materialize.

• For instance, if police fail to patrol designated hotspots effectively, this could directly correlate with unchanged crime rates.

Identifying Barriers

• Conducting interviews with involved personnel (e.g., police officers) can help identify barriers to proper implementation and understand reasons behind failures or successes.

• Recognizing these barriers is essential for improving future interventions and ensuring accurate evaluations.

Implementation Challenges in Problem-Solving

Understanding Barriers to Implementation

• The discussion highlights various barriers that can hinder effective implementation, such as time constraints between calls and delays in receiving necessary data.

• Emphasizes the importance of qualitative research methods, like interviews, to uncover these barriers during the evaluation process.

The SARA Model for Problem Solving

• Introduces the SARA model (Scan, Analyze, Respond, Assess) developed by John Eg and Bill Spellman in 1987 as a framework for addressing problems.

• The first step involves scanning to identify emerging or worsening issues through statistical analysis.

Importance of Detailed Analysis

• Stresses the necessity of conducting a thorough analysis after identifying a problem rather than rushing into solutions.

• A deep understanding of circumstances and motivations is crucial for formulating effective solutions.

Implementation Complexity

• Discusses Jerry Racliff's acronym "PANDA," which separates solution identification from deployment due to its complexity.

• Highlights that successful implementation requires clear roles and responsibilities among all involved parties to avoid confusion.

Insights from Jerry Racliff's Work

• Racliff’s book "Reducing Crime" discusses how many crime reduction initiatives fail due to unclear individual interpretations of their roles.

• Emphasizes the need for clarity in communication regarding who will coordinate efforts during interventions.

Goals and Objectives in Interventions

• Introduces the concept of setting specific objectives using SMART criteria (Specific, Measurable, Achievable, Relevant, Time-bound).

• Identifies the necessity for an analyst to monitor data closely throughout the intervention process.

Documentation and Clarity in Implementation Plans

• Stresses that detailed documentation is essential so others can replicate studies or interventions accurately.

• Ambiguity can lead to complications; thus, every aspect must be clearly defined within intervention plans.

Support Structures Needed for Success

• Discusses the importance of identifying necessary support systems within organizations and external agencies involved in interventions.

Intervention and Implementation Challenges

Importance of Documenting Interventions

• Emphasizes the necessity of documenting both the problem and the intervention to measure their relationship effectively.

• Highlights that cooperation among various stakeholders is crucial, noting issues when individuals or agencies do not collaborate as expected.

Case Study: Environmental Criminology in Swansea

• Discusses a specific environmental criminology study focused on a problem in Swansea, Wales, where bar fights led to injuries from broken glass.

• Describes how the issue involved patrons using broken glass as weapons, resulting in severe facial injuries.

Development of Safer Glasses

• Introduces the creation of "Safer Glasses," designed to shatter into small pieces rather than sharp shards during altercations.

• Explains how these glasses were intended to reduce injury severity during fights by minimizing sharp edges.

Evaluation of Impact

• Presents data showing a decrease in incidents involving safer glasses while noting no significant change in bottle-related incidents.

• Indicates that after initial success, there was an unexpected rise in incidents with safer glasses due to their fragility.

Identifying Barriers and Solutions

• Discusses interviews with bar owners revealing that the new glasses often broke easily, leading establishments to revert to traditional glassware.

• Stresses the importance of understanding barriers through qualitative research for effective intervention design and implementation.

Broader Implications for Evaluations

• Notes that evaluations can reveal unforeseen outcomes such as problem displacement or diffusion of benefits from interventions.

• Concludes with a reminder that thorough evaluation processes are essential for understanding both successes and emerging challenges.

Resources for Crime Analysis and Prevention

Recommended Readings

• The speaker mentions a book titled "Reducción del delito" by Jerry RCliff, which serves as a guide for police leaders but is also valuable for anyone interested in crime analysis and prevention.

• Another recommended resource includes works by Nick Tilly and Ray Poon, focusing on realistic evaluations of crime prevention strategies, discussing not only what works but under what circumstances.

• The discussion emphasizes the complexity of crime prevention effectiveness, highlighting that it varies based on specific contexts and populations involved.

Implementation Science

• The speaker introduces the concept of implementation science, mentioning checklists as useful tools for systematic crime analysis and intervention planning.

• A lengthy English document is referenced as a manual providing tools for effective evaluation and implementation of interventions in crime prevention.

Engagement Opportunities

• The speaker invites participants to connect via email or LinkedIn to discuss any questions or share experiences related to project implementations in the field.