What is computer software?

Programs and data that run on a computer

Physical components of a computer

Input and output devices of a computer

Computer's memory and storage devices

What is the purpose of an operating system?

Control hardware resources and provide a user interface

What is the purpose of antivirus software?

Protect against malware and viruses

What is system software?

Software that allows the computer to operate and manage its hardware and other software.

Software that is used to optimize system performance and manage resources.

Software that is used to create documents and perform specific tasks.

Software that is used to write, compile, and debug computer programs.

What is application software?

Software that is used to create documents and perform specific tasks.

Software that is used to write, compile, and debug computer programs.

Software that allows the computer to operate and manage its hardware and other software.

Software that is used to optimize system performance and manage resources.

What is programming software?

Software that is used to write, compile, and debug computer programs.

Software that is used to create documents and perform specific tasks.

Software that is used to optimize system performance and manage resources.

Software that allows the computer to operate and manage its hardware and other software.

What is utility software?

Software that is used to optimize system performance and manage resources.

Software that is used to write, compile, and debug computer programs.

Software that allows the computer to operate and manage its hardware and other software.

Software that is used to create documents and perform specific tasks.

Understanding the computer software

Revealing personal data can lead to threats like identity theft, fraud, bullying, and blackmail. 1.Identity Theft Definition: Identity theft occurs when someone steals your personal information and uses it without your permission. This can include your name, Social Security number, or bank details. Example: If someone gets your Social Security number, they could open a credit card in your name and run up bills that you would have to pay. 2.Fraud Definition: Fraud is when someone deceives another person to gain something of value, like money or personal information. This is often done through lies or tricks. Example: A person might call you pretending to be from your bank and tell you that you need to confirm your account details. If you give them your information, they may steal your money. 3. Bullying Definition: Bullying is when someone repeatedly hurts, threatens, or picks on another person. This can happen in person or online (cyberbullying). Example: If someone sends hurtful messages or spreads rumors about you on social media, that’s a form of bullying. 4. Blackmail Definition: Blackmail is when someone threatens to reveal harmful or embarrassing information about you unless you give them something they want, usually money or favors. Example: If someone takes a private photo of you and threatens to share it unless you pay them, that’s blackmail. Summary Identity Theft: Stealing personal information for illegal use. Fraud: Deceiving someone for personal gain. Bullying: Repeatedly hurting or threatening someone. Blackmail: Threatening to expose information unless demands are met. Understanding these terms helps you recognize and protect yourself from potential dangers in both real life and online. If you see any signs of these actions happening, it’s important to talk to a trusted adult or authority figure. There are several guidelines for you to be aware of to keep your personal data confidential: •Have strong passwords set on any account that holds personal data. Stronger passwords include characters, numbers and symbols and are not a recognisable word. •Encrypt (scramble text so that it cannot be read without a decryption key) any personal data that you store on your computer. •Have a firewall present, scanning incoming and outgoing data from your computer system. firewall : a security measure that can be implemented to monitor traffic into and out of a computer and prevent external users gaining unauthorised access to a computer system. A firewall is a security measure that helps protect a computer system by monitoring and controlling the traffic that comes into and goes out of the system. Think of it as a barrier between your computer and the outside world. It prevents unauthorized users from accessing your computer while allowing authorized traffic to pass through. •Regularly scan your computer with preventative software, such as an anti-virus package, that is used to identify a virus on a computer and remove it. Anti-virus: software that is used to identify a virus on a computer and remove it •Make use of any biometric devices (devices that measures a person's biological data, such as thumbprints), that are built into technology. biometric devices: Unique physical characteristic of a person that can be used by a computer for identification purposes. https://www.aratek.co/news/biometric-devices-definition-and-examples Biometric devices are tools that use unique physical characteristics of a person for identification purposes. This means they can recognize who you are based on features that are unique to you. Here are some examples of biometric characteristics: Fingerprint Recognition, Facial Recognition, Voice Recognition •Only visit and provide data to websites that are a trusted source. •Do not open any email attachments from a sender you do not recognise. •Check the URL attached to any link requesting data to see if it is genuine. •Be cautious about any pictures or opinions that you post or send to people. •Remove data about your location that is normally attached to your photos and videos that you may post, such as geotags. Geotag: an electronic tag that assigns a geographical location A geotag is an electronic tag that assigns a specific geographical location to a piece of information, like a photo or a video. Geotags can help people understand where a photo was taken or where an event occurred, making it easier to organize and find information based on location. •Do not become friends on social networking sites with people you do not know. •Set all the privacy controls to the most secure setting that are available on social media accounts. •Report and block any suspicious user. •Use a nickname or pseudonym when using the internet for entertainment, for example, playing games. •If it is possible, use a virtual private network (VPN), an encrypted connection that can be used to send data more securely across a network. Virtual private network (VPN) : an encrypted connection that can be used to send data more securely across a network A Virtual Private Network (VPN) is a special way to connect to the internet that keeps your information safe. Imagine you are sending a secret message to a friend. You want to make sure no one else can read it while it travels. A VPN helps you do just that! It creates an encrypted connection, which means it turns your message into a code that only your friend can understand Example: Public Wi-Fi Safety: When you use public Wi-Fi, like in a café, your data can be easily accessed by hackers. If you connect to a VPN while using that public Wi-Fi, your data is encrypted, making it much harder for anyone to steal your information.

You are a teacher of an OCR GCSE computer science year 9 class. You have just completed a lesson where the lesson goals were: Define hacking in the context of cybersecurity Explain how a DDoS attack can impact users of online services Identify strategies to reduce the chance of a brute force attack being successful Explain the need for the Computer Misuse Act Create an exit quiz to check understanding.

Teaching English Introduction to the course: Language learning and teaching A 2 Characteristics of the language learners: Studying a system that aligns with international standards. A3 Cognitive factors in language learning: Addressing questions and obtaining necessary information regarding phenomena such as transfer, interference, and generalization; A4 Inductive and deductive language learning: ability and intelligence; and the phenomenon of systematic forgetting A5 Language learning methods and strategies: Familiarizing with foreign language learning methods, strategies for learning foreign languages, and communication strategies A6 International Assessment System of language skills in CEFR, IELTS, TOEFL: effective methods and strategies used to improve language skills (listening, reading, writing, speaking) A7 Psychological factors in language learning: Exploring various psychological factors such as self-esteem, shyness, risk-taking, anxiety, attitude, and motivation A8 The effectiveness of authentic materials during the learning process: The role of tasks and games in teaching foreign languages A9 Errors in language learning: Discussing types of errors, identifying and describing errors, causes of errors, and fossilized errors A10 Error correction or error analysis approaches: developing students' ability to apply their knowledge in practicing error correction A11 Age-related factors in language learning: Exploring types of comparisonand contrast, focusing on topics such as the age hypothesis and bilingualism, and providing a detailed explanation of these concepts A12 Teaching grammar: Studying grammar teaching methods; deductive and inductive approaches in grammar teaching; A13 Teaching grammar through context: linguistic intuition; language phenomena; using grammatical dictionaries; analyzing grammatical tasks; and designing exercises, tasks, and tests through completing grammarbased activities. A14 Teaching vocabulary. Seeking answers to questions such as 'What is a word?' and 'What does it mean to learn a word?' A15 Teaching vocabulary in context: teaching lexical units/phrases/collocations; introducing new vocabulary; using corpus data for pedagogical purposes; developing students' vocabulary learning strategies A16 Assessing vocabulary tasks: designing vocabulary tasks, exercises, and tests. In international assessment systems such as CEFR, IELTS, and TOEFL, grammar accuracy and lexical resource A 17 Teaching pronunciation: Understanding the importance of pronunciation for successful communication; teaching stress; teaching intonation A18 Modern technologies in teaching pronunciation A19 Error correction methods: watching to various experiences in this area and analyzing video lessons from international experts in the field A20 Analysis of skill integration in language learning: Understanding the stages of developing skill integration; integration of the four language skills; task-based integration; and project-based integration. A21 Teaching listening comprehension A22 Modern technologies in teaching listening comprehension A23 Teaching Speaking A24 Modern technologies in teaching Speaking A25 Teaching Reading A26 Modern technologies in teaching Reading A27 Teaching Writing A28 Modern technologies in teaching Writing A29 The role and importance of translation in teaching a foreign language A30 Module 2. International standards for teaching and assessment Classroom Language: The teacher's actions; the teacher's voice; the teacher's intonation; using the foreign language in the classroom A31 Foreign language environment: asking questions in the foreign language, giving instructions in the foreign language, providing oral explanations in the foreign language, and issues related to the use of the native language in the foreign language class. A 32 Designing curriculum: Studying, analyzing, and working with curricula designed for schools, lyceums, and colleges. A33 Planning lessons and the structure of lesson plans: determining thesequence of lessons, objectives, tasks, and expected outcomes; choosing the lesson structure for planning A34 Designing tasks for different stages of the lesson: Starting the lesson; concluding the lesson; connecting tasks within the lesson A35 Time management: allocating appropriate time for tasks during the lesson; and providing homework assignments A36 Educational materials and resources: Effective use of existing educational materials and resources; anticipating and addressing potential issues Planning and adapting materials: to the situation during teaching and working on lesson planning for groups of students with different abilities. A37 Classroom research: Stages of classroom research, data collection, analysis, and planning; creating/preparing the materials needed for data collection; distinguishing between the positive and negative aspects of the research A38 Data analysis: creating/preparing the materials needed for data collection; distinguishing between the positive and negative aspects of the research. A39 Peer lesson observation: Observing lessons; conducting interviews; questionnaires for teachers and students; maintaining a daily record; discussing problematic situations/events; notes and other aspects; the process of lesson observation: stages of observation; presenting observation results both orally and in writing. A40 Educational materials and national values: important tool for implementing and promoting educational standards, as well as national values. A41 Differences between methods of teaching foreign languages: practical application of modern methods in language teaching; foreign experiences in language teaching: the grammar-translation method; the method of conducting lessons entirely in the foreign language; the audio-linguistic method; and communicative methods. A42 Methods used in the local environment and their analysis: Discussion of the positive and negative aspects of various methods; language and culture; teaching/learning processes; the role of the native language in learning a foreign language; and the psychological foundations of foreign language teaching. A43 Teaching a foreign language through computer technologies A44 Types of independent work and its implementation A45 Principles of Assessment in foreign language teaching А46 Issues in Language Assessment А47 Alternatives in Assessment А48 Test methods. Methods and criteria for assessing language aspects: written expression, reading, listening comprehension, speaking, А49 integrating language skills: vocabulary; grammar; alternative forms of assessment; planning assessment; critical analysis; principles for designingtest tasks: scientific rigor, consistency, conciseness, clarity, informality, logical sequence, and systematic approach. А50 Foreign language for ESP. Studying and analyzing needs; setting objectives for teaching a foreign language in a specific field or professional area; defining teaching approaches in curriculum development; and discussing topics related to these areas. А51 Selecting textbooks, materials and resources А52 Content-based Instruction (CBI) А53 Strategies-based Instruction А54 Lifelong Learning: Teacher development, PreSETT, InSETT А55 The Role of Teaching Practice A56 Organization and implementation of compulsory and non-compulsory course process in foreign language teaching A57 Organization in and outclass activities A58 Defining the goals and content of foreign language teaching at various levels of the education system in the Republic of Uzbekistan: evaluating educational materials; adapting educational materials; creating educational materials; and discussing the role of the foreign language teacher in specialized fields to gain relevant information. A59 The role of independent study skills: foreign language focused on reading, research and study skills; make revision questions. incclude mcq question. answer the question. true false

We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?

What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94

Understanding the efficiency of algorithms

Related quizzes

Related quizzes