Conferencia: La Evaluación en tiempos de inteligencia artificial generativa | Jornadas de Innovación

Introduction to the Conference

• The second day of the fifth edition of educational innovation conferences at Universidad de Flores begins, focusing on improving teaching practices.

• Emphasis on rethinking the university's role in current times and reflecting on evaluation practices.

• Introduction of Marilina Lipman, an expert in educational quality evaluation and a significant figure in this field.

Marilina Lipman's Background

• Marilina is a professor at the University of Buenos Aires, involved in various educational projects and committees.

• She has extensive experience in evaluating teaching quality and is part of Ibero-American networks focused on education.

• Her conference aims to redefine evaluation practices while addressing contemporary issues like artificial intelligence.

Opening Remarks by Marilina Lipman

• Marilina expresses gratitude for the invitation and highlights the importance of professional development for university educators.

• She acknowledges collaborative efforts with colleagues that led to her participation in this event.

• Prepares to share her presentation, encouraging attendees to engage actively.

Focus on Evaluation Practices

• Presentation outlines key topics related to evaluation as a fundamental human activity among educators.

• Discussion includes historical perspectives and ongoing debates about evaluation methods in higher education.

• Highlights tensions surrounding evaluation amidst advancements like generative artificial intelligence.

Questions Raised About Teaching Practices

• Marilina poses questions regarding what non-university teachers can learn from current evaluation practices.

• Acknowledges diverse experiences among educators present, emphasizing continuous learning needs.

Discussion on Evaluation in Higher Education

Importance of Interaction and Technology

• The use of chat tools can enhance interaction during conferences, providing immediate suggestions.

• Quick responses from technology highlight the need for deeper analysis beyond superficial questions in education.

Vision and Critical Thinking

• Emphasizes the importance of critical vision in education, as stated by Eisner.

• Acknowledges that improving educational practices requires more than technical skills; it involves extensive reading and experimentation.

Trends in Digital Technologies

• Discusses the intersection of digital technologies with evaluation trends in higher education.

• Highlights the dual forces (physical and virtual) shaping contemporary educational experiences.

Hybrid Learning Post-Pandemic

Hibridación en Educación

• Explores how hybrid learning is reshaping university practices post-pandemic, referencing works by Baricco.

• Examines historical political analyses related to AI's impact on education.

Ethical Considerations

• Mentions UNESCO's guidelines addressing ethical implications of generative AI in educational practices.

• Introduces a publication discussing teaching and evaluation strategies within health sciences at UBA.

Collaboration and Evaluation Practices

Co-designing Educational Experiences

• Advocates for collaboration in developing new evaluation practices within higher education settings.

Reflection on Educational Institutions

• Reflecting on Cuban’s idea that societal issues often manifest through educational evaluations.

Current Challenges in University Evaluations

Addressing Societal Needs

• Questions what societal issues influence university evaluations today, emphasizing their relevance to current challenges.

What Should We Learn About Evaluation?

Understanding Digital Technology in Evaluation

• The focus should shift from "what do we do with digital technology in evaluation?" to "how does evaluation fit within current technological ecosystems?"

• Reformulating questions can enhance research and teaching practices related to evaluation.

Purpose and Values of Evaluation

• Evaluation should aim for improvement, not just to measure or control student knowledge.

• Understanding how students learn provides feedback that enhances teaching practices and curriculum development.

Teacher Development Through Evaluation

• Teachers must engage in continuous experimentation and theoretical research to improve their pedagogical skills.

• Evaluating practices helps refine educational projects and curricula beyond just assessing student knowledge.

The Evolution of Evaluation Concepts

Historical Context of Formative Assessment

• Michael Scriven's concept of formative evaluation emphasizes revisiting processes for improvement.

• Traditional evaluations focused on measurement, which may limit the broader educational purpose of assessment.

New Perspectives on Assessment

• A comprehensive view of evaluation should transcend mere measurement and control, embracing collaborative approaches.

• Categories of analysis suggest a more integrative approach to understanding evaluation beyond traditional methods.

Technology's Role in Modern Evaluation

Early Technological Practices

• Initial uses of technology in evaluations were primarily administrative rather than transformative.

• While technology improved efficiency, it often lacked substantive value for enhancing learning outcomes.

Innovative Approaches to Assessment

• Effective use of technology can lead to new discovery-based evaluations rather than merely confirming existing knowledge.

• Emphasizing surprising elements in assessments allows educators to understand student learning processes better.

Collaboration as a Key Element

Collaborative Learning Environments

Evaluation Practices in Education

The Nature of Evaluation

• Traditional evaluations often exclude collaborative work, limiting students to individual assessments.

• Integrating evaluation with daily educational practices enhances its relevance and authenticity.

• Documenting everyday educational practices reduces artificial examination moments.

Public vs. Private Evaluation

• A portion of evaluation should remain private for students, but public validation enriches the learning experience.

• Reference to Edwin Litwin's work emphasizes the importance of contemporary teaching practices.

Balancing Tradition and Innovation

• Good teaching and evaluation practices reflect societal values and aspirations.

• The pandemic highlighted contrasts between traditional and innovative educational methods.

• There is a tendency to avoid evaluation due to perceived inadequacies or over-evaluation.

Rethinking Educational Dichotomies

Addressing False Dichotomies

• The debate between formative and summative evaluations often leads to oversimplified conclusions.

• Proposes a deeper understanding of opposing concepts rather than viewing them as mutually exclusive.

Creative University Models

• Ronald Barnett's concept of a creative university emphasizes imagination in knowledge construction.

• Universities must reimagine themselves beyond just research outputs for societal benefit.

Equilibrium in Educational Structures

Balancing Curriculum and Recognition

• Universities should balance diverse curricula with opportunities for faculty development.

The Role of Universities in Student Personalization

• Jackson argues that universities often depersonalize students, failing to fulfill their evaluative role.

• Collaborative evaluation agendas were necessary during the pandemic to address new teaching and assessment challenges.

• Delays in adapting to online education highlighted the need for theoretical development in distance learning.

Evaluation Theories and Practices Post-Pandemic

• Over a century of evaluative theory provides numerous concepts and tools for assessment.

• Emphasis on digital collaborative tools is crucial for effective evaluation amidst technological access disparities.

• Rubrics emerged as valuable yet potentially misused instruments during the pandemic.

Ethical Considerations in Teaching and Evaluation

• Educators must prioritize content selection based on importance due to time constraints.

• Ethical considerations are essential when using technology, especially regarding feedback timing.

• Accelerated feedback is vital in virtual settings to maintain student engagement.

Transparency in Educational Processes

• A meta-analysis aims to clarify decision-making processes behind educational themes discussed.

• Historical, philosophical, and cultural frameworks are critical for understanding current educational practices.

• Inclusion and recognition of students' identities are important for effective retention strategies.

Addressing Current Trends in Education

• Ethical issues related to generative AI, cognitive biases, and data protection must be central concerns.

• Continuous adaptation of pedagogical knowledge is necessary amid evolving educational contexts.

• Generative AI prompts a reevaluation of established teaching practices.

Reflecting on Teaching Practices

Rethinking Evaluation in Education

• Discussion on what we don't know about evaluation and the need to rethink it.

• Resistance from students towards new evaluation methods; preference for traditional approaches.

• Importance of recognizing the value of didactic knowledge in evaluation practices.

The Role of Subjectivity in Evaluation

• Evaluations should recognize the subjectivity and identity of the evaluated individual.

• Tension between numerical grading and acknowledging student individuality.

• Need for continuous knowledge construction by educators regarding classroom dynamics.

Addressing Isolation in Teaching Practices

• Many educators work in isolation, impacting their teaching effectiveness.

• Use of technology can bridge gaps between different generations of educators and students.

• Importance of adapting teaching methods to engage younger students effectively.

Generational Knowledge Asymmetry

• Knowledge can be both asymmetrical and symmetrical across generations; collaboration is key.

• Traditional university structures may hinder innovative teaching approaches.

• Ethical responsibility to ensure evaluations reflect true understanding, not just rote learning.

Building Connections with Students

• Emphasis on creating connections with students to enhance learning experiences.

• Current evaluation methods often lack cognitive challenge; need for deeper assessments.

• Importance of pedagogical practices that consider generational differences among students.

The Value of Small Educational Environments

• Smaller universities can foster closer relationships between faculty and students.

Evaluation Practices and Challenges

Insights on Evaluation

• Discusses the importance of adapting evaluation practices based on students' progress, from first-year to graduating students.

• Reflects on traditional methods of feedback, such as public lists of grades, and contrasts them with modern approaches using technology.

• Emphasizes the role of educators in providing moral and ethical guidance during evaluations.

Availability of Resources

• Mentions that materials from the session will be available on YouTube for further reference.

• Highlights the need for evaluations to be surprising in a positive way rather than unexpected or secretive.

Challenges in Evaluation Processes

• Questions how to balance evaluation processes with grading systems while forming competent professionals.

• Identifies potential challenges universities face regarding hybrid learning and advancements in intelligence technologies.

Formative Assessment Strategies

Importance of Formative Evaluation

• Acknowledges that formative assessments were utilized effectively during the pandemic despite initial skepticism about their feasibility.

• Argues that formative evaluations should influence final grades to reflect a holistic understanding of student performance.

Criteria for Knowledge Acceptance

• Stresses the need for clear criteria within academic groups regarding acceptable knowledge levels among students.

• Points out discrepancies in grading standards among faculty members, affecting consistency in student evaluations.

Addressing Subjectivity in Grading

Evaluating Student Performance

• Discusses the challenge of establishing uniform standards for what constitutes acceptable knowledge across different courses.

• Highlights issues with subjective grading practices that may not accurately reflect student understanding or capabilities.

Evidence-Based Assessment

• Calls for transparency regarding expectations and evidence required for passing courses, emphasizing fairness in evaluation methods.

• Notes that many students fail not due to lack of knowledge but because of subjective assessment criteria used by instructors.

Historical Context and Research Findings

Longitudinal Studies on Teaching Practices

Evaluation Criteria and Student Performance

• Evaluation ranges among teachers show consistency across courses, subjects, and shifts.

• Discussion on whether grades reflect actual student performance or teacher subjectivity.

• Importance of understanding the implications of grading scales on student perception.

Challenges in Assessment Practices

• Need for assessments that challenge students beyond simple solutions.

• Emphasis on practical application versus theoretical frameworks in education.

• Consideration of the impact of grades on students' emotional well-being.

Post-Pandemic Educational Landscape

• Recognition of changes in student readiness and emotional states post-pandemic.

• Universities must adapt to educate effectively while addressing societal issues.

• Urgency for educational practices to evolve to meet current challenges.

Reflection and Continuous Improvement

• Importance of reflective practice in higher education institutions.

• Acknowledgment of contributions from participants during discussions.

• Call for ongoing dialogue to reform educational theories and practices.

Closing Remarks and Future Engagement

• Gratitude expressed for participation and insights shared during the session.