PERCEPTION & INDIVIDUAL DECISION MAKING KELOMPOK 3

Duplicate of PERCEPTION & INDIVIDUAL DECISION MAKING

Health 11/12 Review for Final Exam Core Concepts - Mental and Emotional Health, Substance Abuse Prevention, Safety and Violence Prevention, Family Life and Human Sexuality, Disease Prevention and Control, Healthy Eating Health Education Skills - goal setting, decision making, accessing information/resources, analyzing influences, communication, self-management, advocacy DIMENSIONS of Wellness - social, spiritual, emotional/mental, environmental, financial, intellectual, multicultural, occupational, physical, sexual RISK factors - anything that increases the risk of disease, injury, or illness. PROTECTIVE factors - anything that decreases the risk of disease, injury, or illness. INTERNAL health factors - health factors that can be either hereditary and genetic or acquired elements -- include smoking and personal diet or eating habits. Example – a genetic predisposition to an illness. EXTERNAL health factors - health factors that are part of the direct outer environment, the geographical location, micro-organisms, socio-economic elements that could affect an individual's health. Example – being unable to afford mental health services. Unit 1- Managing Personal and Community Wellness Explain Maslow’s Hierarchy of Needs in your own words using the image provided. Explain how each Social Determinant of Health may impact a person’s health. Levels of Disease Prevention • PRIMARY The goal is to avoid conditions altogether. • SECONDARY The goal is early detection. • TERTIARY The goal is to minimize the damage (manage). Define the following terms. Fads/Trends Sleep hygiene Driver safety Unit 2- Investigating Social Ecological Factors on Well-Being Socio-Ecological Model – The SEM examines how health behaviors form based on characteristics of individuals, communities, nations and levels in between. Each level overlaps with other levels signifying how the best public health strategies are those that encompass and target a wide range of perspectives. Interpersonal (personal) health vs. intrapersonal (relationship) health Health INEQUITY - systemic, ingrained and unjust barriers that prevent segments of the population from having the opportunity of health leading to health disparity. IMPLICIT BIAS - a form of bias that occurs automatically and unintentionally, that nevertheless affects judgments, decisions, and behaviors. Research has shown implicit bias can contribute to unequal access to quality healthcare, negative patient-provider relationships and interactions; and create mistrust in the healthcare system and practitioners among patients. This can contribute to health disparities. Health DISPARITY - represents a difference in health between populations. It is often used to describe disease burden and other negative health outcomes socially disadvantaged groups may face. Health EQUITY - The opposite of health inequity. It describes a system that supports a high standard of health and healthcare for all people. Racism - Beliefs, attitudes, institutional arrangements, and acts that tend to denigrate individuals or groups because of phenotypic characteristics or ethnic group affiliation. DISCRIMINATION - An unjust differential treatment of a person or a group. PRIVILEGE- The unearned access to resources and social power that are only available to some because of their membership within certain social groups. OPPRESSION is the act of taking away choices from others and can be defined as a system that maintains advantage and disadvantage based on social identities and that acts on multiple levels from interpersonal to institutional and societal. (internalized, interpersonal, institutional, structural) Systematic Oppression - Intentional disadvantage of groups of people based on their identity while advantaging members of dominant group (race, gender, sexual orientation, language, size, ability, etc.). Intersectionality - The complex, cumulative way in which the effects of multiple forms of discrimination (such as racism, sexism, and classism) combine, overlap, or intersect especially in the experiences of marginalized individuals or groups Unit 3- Accessing Resources and Communicating to Support Mental and Emotional Health What is anger? What is anxiety? What is stress? STRESSORS are the things that cause stress. Stressors can be internal and external. A stressor may be a one-time or short-term occurrence, or it can happen repeatedly over a long time. INTERNAL Stressors - are made by your belief system and the way you evaluate yourself. Examples include pessimistic attitude, negative self-talk, deep need to be perfect, low self-esteem or body image, unhealthy standards for self. EXTERNAL Stressors - are stressful things that happen in your surroundings and/or in your environment. Examples include busy schedules, work problems, family issues, financial trouble, social problems, injury, unforeseen circumstances. Socio-economic issues are also a part of external stressors such as poverty, violence, and racism. Define the following mental health conditions. Depression Eating disorders NSSI Non-suicidal self-injury Grief/Loss Suicide prevention A.C.T. • ACKNOWLEDGE- Tell them in a caring way that you recognize that they are having a problem • CARE- You can show you care by actively listening - put away anything else you are doing, make eye contact, sit down, ask questions. • TELL-(call 988 for additional help and support) - Tell them it is important that they speak with a trusted adult. Help them figure out who this may be and offer to go with your friend. A social norm is an unwritten, informal rule meant to guide behavior among the of society. It distinguishes between acceptable and unacceptable, good and bad, and so on. Social norms can influence a person with emotional or mental health disorders, access to care and stigmatize their situation. STIGMA- a mark of disgrace associated with a particular circumstance, quality, or person. • Self-stigma - This describes the internalized stigma that people with mental health conditions feel about themselves. • Public stigma - This refers to the negative attitudes around mental health from people in society. • Institutional stigma - This is a type of systemic stigma that arises from corporations, governments, and other institutions. Unit 4- Evaluating Risks of Substance Use and Abuse Harm Reduction - a set of practical strategies and ideas aimed at reducing negative consequences associated with drug use. Explain how each level of the Social Ecological Model is impacted by addiction. Individual Relationship Community Society SEM Level Contributing/Risk Factors to substance use Preventative/Protective Factors for substance use Individual Interpersonal/Relationship Community Society Unit 5- Analyzing Influences to Examine Ways to Increase Safety and Reduce Violence HATE CRIME - a crime, usually violent, motivated by prejudice or intolerance toward an individual’s national origin, ethnicity, color, religion, gender, gender identity, sexual orientation, or disability. Explain how the media influences violence in society. The Pyramid of Hate Explain the escalation of hate using the Pyramid of Hate visual. List several hate crime motivators. Example: age HEALTHY Relationship Signs - comfortable pace, trust, honesty, independence, respect, equality, kindness, taking responsibility, healthy conflict, fun UNHEALTHY Relationship Signs - intensity, possessiveness, manipulation, isolation, sabotage, belittling, guilting, volatility, deflecting responsibility, betrayal Sexual Assault is a sexual behavior WITHOUT consent. Human trafficking - the recruitment, harboring, transportation, provision, or obtaining of a person for labor or services, using force, fraud, or coercion for the purpose of subjection to involuntary servitude, peonage, debt bondage, or slavery. Sex trafficking - commercial sex act induced by force, fraud, or coercion, or in which the person induced to perform such an act has not attained 18 years of age. Trafficking happens using… • Force - using violence to control someone. • Fraud - using lies to control someone. • Coercion - using threats to control someone. Unit 6- Family Life and Human Sexuality Agency - A belief about yourself and the extent to which you can act on that belief. • The ability to choose freely one’s own narrative. • To embrace the idea that I am the cause (or agent) of my own thoughts and actions. • Personal agency is a personal responsibility for who we are, what we experience, what we do about that experience, and how we shape our world to give us more of the experiences we want. SEXUAL Agency • The ability to choose your own interests and desires vs. what we see in the media or others’ perceptions • The ability to identify, communicate, and negotiate one’s sexual needs • The ability to initiate behaviors that allow for the satisfaction of those needs Sexually Explicit Material - photographs, videos, films, magazines, and books whose primary themes, topics, or depictions involve sexuality that may cause sexual arousal. Sexual scripts - thoughts, patterns, or behavior that a person has about themselves in a romantic or sexual context. It is how people picture themselves or want to project themselves in front of others. Reproductive Rights of Teens - In Maryland, teens have the right to an abortion, keep their child, obtain and use birth control, paternity tests, adoption, give up custody of their child within 10 days of birth (Safe Haven Law). • REPRODUCTIVE RIGHTS- legal rights and the freedom of the individual to control decisions regarding contraception, abortion, sterilization and childbirth. • SAFE HAVEN LAW- a distressed parent who is unable or unwilling to care for their infant can safely give up custody of their baby, no questions asked. CONSENT is an agreement between participants to engage in sexual activity. • It is clearly and freely communicated, verbal, and affirmative. Consent CANNOT be given if… • A person is underage, one or both partners is intoxicated or incapacitated by drugs or alcohol, one partner is asleep or unconscious, one partner feels pressured, threatened or intimidated, or one partner holds a position of power or authority over the other. Unit 7- Advocating for Enhanced Nutrition, Food Systems, and Health Outcomes Dietary Guidelines for Americans Guideline 1: Follow a Healthy Dietary Pattern at Every Life Stage Guideline 2: Customize and Enjoy Food and Beverage Choices to Reflect Personal Preferences, Cultural Traditions, and Budgetary Considerations Guideline 3: Focus on Meeting Food Group Needs with Nutrient-Dense Foods and Beverages, and Stay Within Calorie Limits Guideline 4: Limit Foods and Beverages Higher in Added Sugars, Saturated Fat, and Sodium, and Limit Alcoholic Beverages FOOD DESERT- a neighborhood where there is little or limited access to healthy and affordable food such as fruits, vegetables, whole grains, low-fat milk and other foods that make up the full range of a healthy diet. FOOD INSEQURITY lack of access to a sufficient amount of food because of limited funds. More than 49 million American households are considered food insecure and are vulnerable to poor health as a result. PROCCESED FOODS- any raw agricultural commodities that have been washed, cleaned, milled, cut, chopped, heated, pasteurized, blanched, cooked, canned, frozen, dried, dehydrated, mixed or packaged — anything done to them that alters their natural state.

Revolutionising Education: Unleash AI to Spark Joy in the Classroom. What is Artificial Intelligence (AI)? • Definition: AI involves creating computer systems that can perform tasks typically requiring human intelligence. These include learning, reasoning, problem-solving, perception, and language understanding. • Examples in Everyday Life: From personal assistants like Siri and Alexa to more complex applications like predictive analytics in healthcare and autonomous driving. Two Types Artificial Intelligence (AI) • Generative AI: refers to a type of artificial intelligence technology that can generate new content, such as text, images, music, and videos. It leverages advanced algorithms to understand and replicate patterns from existing data, allowing it to create original outputs that mimic human-like creativity. Examples include models that can write like a human, generate realistic images from textual descriptions, or compose music. • Large Language Models: are a subset of Generative AI specifically designed to understand and generate human language. These models are trained on vast amounts of text data, which enable them to perform a variety of language-based tasks such as translation, summarization, answering questions, and even engaging in conversation. Notable examples include OpenAI's ChatGPT, Google Bard, and Microsoft Bing. AI in Education? • Enhancing Learning: AI can personalise learning based on individual student needs by adapting materials and pacing. • Automating Tasks: AI can automate administrative tasks like lesson planning and scheduling, allowing educators more time to focus on teaching and building relationships. Ethical Considerations? • Privacy and Security: Ensuring student data is protected and not misused. • Bias and Fairness: Developing AI systems that provide equal opportunities for all students and do not inherit or amplify biases. • Transparency and Accountability: Making AI decisions in education understandable and subject to checks and balances. Our Top 10 AI For Educators • Classroom conductor – ChatGPT - A versatile AI that assists teachers with emails, lesson plans, generating quiz questions, and example student pieces. • Digital Design Dynamo – Canva - With its AI Magic Media app, Canva helps create engaging visuals and videos, making digital design accessible. • Maetstro of Music – Suno - Instantly generates songs on any lesson topic or converts your lyrics into music, enhancing learning with tunes. • Teacher’s AI Ally – School AI - Focused on educator needs, it features tools for creating interactive exit tickets and engaging chat bots. • Differentiator – Diffit - Transforms PDFs and YouTube videos into differentiated worksheets and activities across languages and reading levels. • Quiz Master – Quizalize - Turns any content into quizzes or games, engaging students with interactive challenges based on lesson material. • Presentation Pro – Gamma - Helps create stunning presentations quickly, ideal for classroom use or professional meetings. • Interactive Lesson Launcher – Cruipod - Quickly generates interactive presentations for classroom use, integrating activities seamlessly into lessons. • Note-Taking Ninja – LLava - Produces study notes and quiz questions from any photo or image, simplifying study material generation. • Creative Story Spinner – StroyWizard - Enables teachers to create custom stories incorporating elements from their own classrooms, linking imagination with academic achievement.

What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94

We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?

Related quizzes

Related quizzes