Loading...
EVALUACIÓN SESIÓN 3
Quiz by Lucas Rosendo Cruz Ávila
Customize this quiz to suit your class
Instantly translate to 100+ languages
Tag the questions with any skills you have. Your dashboard will track each student's mastery of each skill.
Give this quiz to my class
El modelo geométrico son arreglos triangulares con formas o elementos, que se puede representar como una multiplicación.
Observa el arreglo rectangular y deduce la multiplicación que representa.
4x6=24
6x6=36
4x4=16
6x5=30
El modelo geométrico son arreglos triangulares con formas o elementos, que se puede representar como una multiplicación.
Observa el arreglo rectangular y deduce la multiplicación que representa.
Lee el siguiente problema:
En la casa de Fernanda juntaron botellas de vidrio para llevarlos a una empresa que las recicla. Analiza cómo las organizarán y represéntalo a manera de suma y multiplicación.
Para multiplicar con el modelo geométrico se debe formar filas y columnas.
Selecciona la multiplicación que representa a la ilustración.
HEALTH EDUCATION 3. SPECIFIC OBJECTIVES: Students should able to know about_______ 1. definition of health education 2. aims of health education 3. objectives of health education 4. principles of health education 5. scope of health education 6. planning of health education 7. steps in planning health education 8. levels of health education 9. doctors s responsibility 4. INTRODUCTION: Health education is a term frequently used by health care professional. its aims at individual and community health. Health education is the translation of what is known about health into desirable individual and community behaviour pattern by means of an education process. Definition: “A process aimed at encouraging people to want to be healthy , to know how to stay healthy, to do what they can individually and collectively to maintain health And seek help when needed”. OBJECTIVES - To inform people or disseminate scientific knowledge about prevention of disease and promotion of health - To motivate people to change their habits and lifestyle that are harmful to their health also motivate people to adopt habits and ways of living conducive to healthy living. - To guide the people who need help to adapt and maintain healthy practices and lifestyle by showing proper community resources. --- PRINCIPLES OF HEALTH EDUCATION - Credibility Of Message: It is the degree to which the message to be communicated is perceived as trustworthy by the receiver. - Creating interest among participants: It is a psychological principle that people are unlikely to listen to things that are not of their interest. If a health programme is based on the felt needs, people will participate in the programme willingly. - Motivating the participants: Motivation is like a petrol engine that drives the mental engine. It is the fundamental desire in every person to learn. Motivation is contagious; one motivated person may spread motivation throughout the group. 13. - Enhance comprehension of content: It means health education should be based on the level of understanding, education and literacy of people at whom the teaching is directed. Teaching should be within the mental capacity of the audience. - Ensure reinforcement: Repetition at intervals is necessary to promote learning. Without reinforcement and feedback, students can go back to the pre-awareness stage. - Encourage active participation: Health education should aim at encouraging people to work actively with health workers and others in identifying their own health problems and also in developing solutions. 14. - Learning by doing: Teaching is effective when individuals actively participate in health education. Learning becomes active and quicker if the individuals are made active physically as well as psychologically. - Known to unknown: The people in a community know something and the health educator enlarges this knowledge. If the health educator links new knowledge with the old knowledge, it can enhance learning. - Maintaining good human relations: Sharing of information, ideas and feelings happens most easily between people who have a good relationship. 15. - Setting an example: The health educators should set a good example in the topic they are dealing with as it fosters better understanding. - Regular feedback: Feedback is one of the key concepts of the system approach. The health educator can modify the elements of the system in light of the feedback from his audience. For effective communication, feedback is of paramount importance - Efficient leadership: Leaders are agents of change and they can be made use of in health education work. Psychologists have shown and established that we learn best from people we respect and regard. 16. The essential attributes of a leader are as follows - Understands the needs of the community. - Provides proper guidance. - Takes initiative. - Is receptive to the views and suggestions of people. - Identifies himself with the community. Is selfless, honest, impartial, considerate and sincere. - Is easily accessible to people. 17. SCOPE OF HEALTH EDUCATION 1. Nutrition 2. Hygiene 3. Family health 4. Disease prevention and cantrol 5. Psychological health 6. Prevention of accident 7. Use of health services 8. Human biology 19. - Nutrition: The aim of nutrition education is to guide people to choose optimum and balanced diets, remove prejudices and promote good dietary habits. nutrition education is a major intervention for the prevention of malnutrition, promotion of health and improving the quality of life. 20. - Hygiene: This has two aspects: personal and environmental. Personal: The aim of personal hygiene is to promote standards of personal cleanliness . Environmental: Has two aspects: Domestic and community. All environmental sanitation programmes should include health education 21. - Family health: The family is the first defence as well as the chief reliance for the well-being of its members. One of the main tasks of health education is to promote family self-reliance, especially regarding the family's responsibilities in child bearing, child rearing, self-care and in influencing their children to adopt a healthy lifestyle. 22. - Disease prevention and control: Drugs alone will not solve health problems. Without health education, a person may fall sick again and again from the same disease. Educating the people about the prevention and control of locally endemic diseases is the first of the eight essential activities in primary health care. 23. - Psychological health: Psychological health problem can occur everywhere. There is a tendency to an increase in the prevalence of psychological diseases when there is a change in society from agriculture to an industrial economy and when people move from the warm intimacy of a village. 24. - Prevention of accidents: Accidents are a feature of the complexity of modern life. Accidents can occur in home, road and place of work. The predominant factor in accidents is carelessness that can be tackled by health education. 25. - Use of health services: Many people, particularly in rural areas, do not know what health services are available and many more do not know. There is a communication gap between the public and state health administration in the form of feedback for further improvement of health services. One of the declared aims of health education is to inform people about the health services available in their community. 26. PLANNING FOR HEALTH EDUCATION planning: is the process of making thoughtful and systemic decision about what needs to be done , how it has to be done, by whom And with what sources. 27. Principles of planning health education 1) Focus on actual current needs and context of community: It is important that plans are made with the needs and context of the community in mind. Health education should try to understand what is currently happening in the community one works in. 2) Plan for basic needs and interest of the community: Consider the basic needs and interests of the community. If the local needs and interests are not kept under consideration, the plans may not be effective. 28. 3) Planning with actual beneficiaries of health education: Plan with the people involved in the implementation of an activity. If people are included in planning, they will be more likely to participate and the plan will be more likely to succeed. 4) Identify and use all relevant community resources: It is essential that the health educator identify all the relevant resources that are locally available which could be used for benefit of people receiving the health education. 29. 5) Follow principle of flexibility: Planning should be flexible, not rigid. One should be able to modify the plans when necessary. For example, you would have to change your priorities if a new problem needing an urgent response arose. 6) A realistic plan not hypothetical: The planned activity should be achievable and take into consideration the financial, personal resources available and time constraints. Planning must be realistic; do not plan unachievable activities. 30. Steps in planning health education Planning is a continuous process. It does not just happen at the start of project . Health education must be well planned to actually improve and promote individual, family and community health 31. - Needs assessment: Conducting needs assessment is the first and probably the most important step in any successful planning process. assessment is the process of identifying and understanding the health problems of the community and their possible causes. - Identify priorities: After identifying the needs and resources of the community, the next is to identify their priorities because each community may have several problems but the urgent have to be given top priority in health education. For example: goitre 32. - Set the goals and objectives: In planning the process of health education, setting goals and objectives is the third and most essential step because these goals and objectives serve as consciously thought baseline parameters to be achieved during health education. - Develop strategies: Prior to the implementation of the health education intervention one must plan, develop and evaluate the several alternative strategies to achieve the set goals and objectives of health education because each problem and target community is quite unique. 33. - Implementation: This is the core phase of the health education process which includes carrying out the planned strategies so that the set goals and objectives of health education may be achieved. - Monitor and evaluation: This is the final step of the planning process of health education where continuous monitoring as well as end evaluation is carried out to ensure the degree to which stated goals and objectives have been achieved. 34. LEVELS/APPROACH OF HEALTH EDUCATION 35. INDIVIDUAL LEVEL - Individual Approach: The health education must first create an atmosphere of friendship and allow the individual to talk as much as possible. In this individual teaching we can discuss, argue and persuade the individual to change his behaviour. But by this we can reach to a small population and who come in contact with us. Methods of individual health education 1) Home visit 2) Personal contact/ counselling 3) Personnel letters 36. 1) Home visit: A home visit is one of the best approaches for individual health education because it can become one of the best opportunities for health education with individuals and their families. Home visits are important to understand the real background of families, their living conditions and the environment in which they live. 37. 2) Personal contact/counseling : Personal contacts or counselling (one-to-one communication) is a helping process where one person explicitly and purposefully gives his or her time to assist people explore their situations and act on a solution. After this the counsellor needs to work together with the person to find solutions that are appropriate to their situation. 38. 3) personal letters: Personal letters may also be used for individual health education, where health educators may get an opportunity to dispatch letters or printed education material to the people in a target community. 39. GROUP LEVEL Group health education may be useful way to deliver health education massages in efficient manner. A well organized group permits sharing of experiences and skills so that people are able to learn from each other. 40. Methods of group discussion 1)Lecture method: (Chalk & Talk ) A lecture may be defined as carefully prepared oral presentation of facts organized thoughts and ideas by a qualified person. The group should not be more than 30 and talk should not exceed 15-20 minutes. By using suitable audiovisual aids. 2) Group discussion: A group is an aggregation of people interacting in a face to face situation. It is a very effective method of health communication. 41. 3) Demonstration: A demonstration is a carefully prepared presentation to show how to perform a skill. This procedure is carried out step by step before an audience. 4) Panel discussion: In a panel discussion 4-8 qualified persons talk about the topic. Sit and discuss a given topic in front of a large group/audience. The chairman opens the meeting. Panel comprises of a chair person and 4-8 speakers. After the main aspect of the subject are explored, the audience is invited to take part. 42. 5) Symposium: It is a series of speeches on a selected subject. Each expert person present it briefly and at the end of session the chair person make a comprehensive summary. Audience are allowed to raise question. 6) Workshops : It consists of series of meetings usually 4 or more with emphasis on an individual work, within the group and with the help of consultants and response personnel. 7) Role play: This is a brief acting out of an actual situation for the benefit of the audience for better understanding. 43. 8) Conference and seminars: This programmes are usually held on a regional, state/national level. Where several experts from different disciplines meet to deliberate on a particular theme, to appraise others of latest knowledge and research in a particular field. 9) Open forum: It refers to the public meeting which are held for various purposes in the community, for example: gram sabha 44. COMMUNITY LEVEL It is meant for a defined community and is not only to create awareness but also to help people understand their health problems and needs, find alternatives solutions to their problems and needs , implement them, evaluate and get feedback and accordingly do the needful. For health education at the community level, it is better to approach local leaders who are influential and who have the people’s confidence. These may include local officers such as gramsevak, panchayat sarpanch ,police officer or block development officer etc . 45. HOSPITAL LEVEL 1) Health Education in OPD/Outdoor: The patient and his attendants have to spend a lot of time in the outpatient department for health check-up, treatment, registration, diagnosis, admission procedure etc. This period can be utilised for health education. For this, the following means/devices can be used: - Exhibiting pictures, posters, charts, bulletin board and models in the waiting hall. - Arranging group discussion, slide show, or documentary film in a proper place and on a proper topic. - Giving health education on a personal level in the consulting room. This mainly includes nutrition clinic, family planning clinic, psychiatric clinic etc. 46. - Distributing pamphlets. - Arranging street plays or nukkad naatak in the outpatient department or its neighbourhood. 47. 2) Health Education in wards/ IPD: While taking care of the patients the indoor patients, doctors s have the opportunities to educate them. This period can be fully utilised to give health education to the patients. For this the following methods can be effective: - Conversation with the patient and motivating him for change in his behaviour. - Imparting health education by arranging live demonstration for nutrition, treatment, diagnosis etc. - Providing clinical or bedside teaching. - Providing incidental teaching to patient and his attendants. 48. - Presenting examples. To describe the gains of health education in an individual suffering from the same health education in an individual suffering from the same disease and arranging a meeting between the patient and the cured old patients.What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?Evaluación Diagnóstica Sesión 1 - CNCEvaluación Evaluacion110.31.b.17.C Topic: Reading/Vocabulary Development