Mr. Smith just made an online purchase at Amazon but did not receive the product. What would you advise him? (Select the best option).

Contact merchant first. If unsuccessful, phone disputes

Allow merchant 15 days, from date of transaction, to correct error before calling to dispute

This is viewed as Fraud; transfer to BCS

Advise cardholders that Disputes will provide him with a refund

Mr. Customer called the CCC stating his online banking has been disabled. When you pull up the profile, you notice his ScotiaCard limits (ABM, POS, OPL, ETL) have been reduced to $2. How would you resolve this inquiry? (Select the best answer)

Transfer customer to Bank Card Security

Ask customer to visit branch with 2 pieces of ID to reinstate limits and online access

Mrs. Customer calls the CCC explaining her recent transaction at McDonalds has declined. When you review her account, you notice an SA (hold) is placed under her Pending Transactions. What needs to happen?

Transfer the customer to Bank Card Security to verify recent transactions.

Refer the customer to the branch to remove hold.

Advise the customer his account is past due; once the payment is made, the hold will be released.

Transfer the customer to disputes to verify transactions and have the hold removed.

Mr. Customer notices a recurring Bill Payment on her Scene Visa Card. Select which of the following step DOES NOT belong?

Speak to disputes first to initiate a file claim

Tried to resolve the issue with merchant first before calling to dispute the transaction

Customer must have cancelled the recurring billing with the merchant

Mrs. Customer signed up for a free trial through SkinFX, however she noticed a charge on her statement in the amount of $35. As you probe further, she claims she did not authorize this charge. How would you proceed with the call? (Select the best answer)

Refer cardholder to the Merchant, not Disputes.

Advise customer that the Merchant is well known to the Bank, and this is a fraudulent charge; Transfer to Bank Card Security.

Since the customer claims she did not authorize this charge, transfer her to Disputes.

Create a case and assign it to the "callcust" Disputes queue to be investigated.

Disputes vs. BCS - Where does your call go?

Workplace Disputes

Consists of federal courts and judges Constitution gives Congress the power to create inferior (lower) courts to meet the nation’s needs -- two main types: District courts -- most cases involving federal laws are first heard in district courts -- U.S. divided into large geographic districts (which covers several states) Appellate courts -- courts that review cases that have been appealed from a lower court -- only considers whether the original trial was fair and legal -- their decisions can be appealed to the Supreme Court Supreme Court -- the highest court in the land (Congress has set the number of justices at nine, and they usually serve for life). Judicial Powers: To protect the Constitution Federal courts have the power to resolve disputes that involve national laws, the federal government, or the states. -- can also try people accused of breaking national laws Dispute only goes directly to Supreme Court if it involves a state or an ambassador from another country; otherwise has to come from a trial and then an appeal in lower courts -- could come eventually from national or state courts -- usually only review cases if they think a decision from a lower court might conflict with the Constitution or a federal law Supreme Court -- has the power of judicial review -- the power of the Supreme Court to decide whether laws and acts made by the legislative and executive branches are unconstitutional

ASEAN, international organization established by the governments of Indonesia, Malaysia, the Philippines, Singapore, and Thailand in 1967 to accelerate economic growth and promote peace and security in Southeast Asia. Brunei joined in 1984, followed by Vietnam in 1995, Laos and Myanmar in 1997, and Cambodia in 1999. East Timor has been granted observer status and is expected to become a full member in 2025. The ASEAN region has a population of more than 700 million, covers a total area of 1.7 million square miles (4.5 million square km), and had a combined gross domestic product of $3.62 trillion as of 2022. Since its establishment, ASEAN has substantially enhanced security and stability throughout Southeast Asia, while also promoting economic growth and cooperation on international issues. Yet certain regional issues remain divisive within ASEAN, such as Myanmar’s civil war, which has proved challenging for the bloc to address uniformly, and relations with China, particularly with regards to economic ties and territorial disputes in the South China Sea. ASEAN’s history ASEAN's 50th Summit ASEAN's 50th SummitDelegates from Southeast Asian nations gather at the 50th ASEAN Summit in Melbourne, March 2024. ASEAN’s origins can be traced back to earlier regional organizations such as the Southeast Asia Treaty Organization (SEATO), founded in 1954, and the Association of Southeast Asia (ASA), established in 1961. These early efforts, however, were limited in scope and membership. In 1967 ASEAN was established by Thailand, Indonesia, Malaysia, the Philippines, and Singapore with the signing of the ASEAN Declaration in Bangkok. The initial aim was to encourage regional cooperation and create a collective front against the spread of communism in Asia, reflecting the geopolitical concerns of the era. Lee Kuan Yew Lee Kuan YewPrime Minister Lee Kuan Yew of Singapore at the Third ASEAN Summit, 1987, in Manila. The organization gained a new level of cohesion in the mid-1970s following the Vietnam War. ASEAN’s first summit meeting, held in Bali, Indonesia, in 1976, resulted in several significant agreements, including the signing of the Treaty of Amity and Cooperation. The end of the Cold War and increased regional development and stability saw ASEAN expand its membership, incorporating Brunei, Vietnam, Laos, Myanmar, and Cambodia by the end of the 1990s. This period also marked a shift toward deeper economic integration, exemplified by the establishment of the ASEAN Free Trade Area (AFTA) in 1992 and the response to the 1997 Asian financial crisis with the Chiang Mai Agreement. The adoption of the ASEAN Charter in 2007 provided a legal and institutional framework defined by three core pillars: the ASEAN Economic Community, the ASEAN Political-Security Community, and the ASEAN Socio-Cultural Community. This structure has helped promote increased cooperation and mutual understanding, despite enormous differences in the political structures, cultural backgrounds, and development levels of member states.

On 8 August 1967, five leaders – the Foreign Ministers of Indonesia, Malaysia, the Philippines, Singapore and Thailand – sat down together in the main hall of the Department of Foreign Affairs building in Bangkok, Thailand and signed a document. By virtue of that document, the Association of Southeast Asian Nations (ASEAN) was born. The five Foreign Ministers who signed it – Adam Malik of Indonesia, Narciso R. Ramos of the Philippines, Tun Abdul Razak of Malaysia, S. Rajaratnam of Singapore, and Thanat Khoman of Thailand – would subsequently be hailed as the Founding Fathers of probably the most successful inter-governmental organization in the developing world today. And the document that they signed would be known as the ASEAN Declaration. It was a short, simply-worded document containing just five articles. It declared the establishment of an Association for Regional Cooperation among the Countries of Southeast Asia to be known as the Association of Southeast Asian Nations (ASEAN) and spelled out the aims and purposes of that Association. These aims and purposes were about cooperation in the economic, social, cultural, technical, educational and other fields, and in the promotion of regional peace and stability through abiding respect for justice and the rule of law and adherence to the principles of the United Nations Charter. It stipulated that the Association would be open for participation by all States in the Southeast Asian region subscribing to its aims, principles and purposes. It proclaimed ASEAN as representing “the collective will of the nations of Southeast Asia to bind themselves together in friendship and cooperation and, through joint efforts and sacrifices, secure for their peoples and for posterity the blessings of peace, freedom and prosperity.” It was while Thailand was brokering reconciliation among Indonesia, the Philippines and Malaysia over certain disputes that it dawned on the four countries that the moment for regional cooperation had come or the future of the region would remain uncertain. Recalls one of the two surviving protagonists of that historic process, Thanat Khoman of Thailand: “At the banquet marking the reconciliation between the three disputants, I broached the idea of forming another organization for regional cooperation with Adam Malik. Malik agreed without hesitation but asked for time to talk with his government and also to normalize relations with Malaysia now that the confrontation was over. Meanwhile, the Thai Foreign Office prepared a draft charter of the new institution. Within a few months, everything was ready. I therefore invited the two former members of the Association for Southeast Asia (ASA), Malaysia and the Philippines, and Indonesia, a key member, to a meeting in Bangkok. In addition, Singapore sent S. Rajaratnam, then Foreign Minister, to see me about joining the new set-up. Although the new organization was planned to comprise only the ASA members plus Indonesia, Singapore’s request was favorably considered.” And so in early August 1967, the five Foreign Ministers spent four days in the relative isolation of a beach resort in Bang Saen, a coastal town less than a hundred kilometers southeast of Bangkok. There they negotiated over that document in a decidedly informal manner which they would later delight in describing as “sports-shirt diplomacy.” Yet it was by no means an easy process: each man brought into the deliberations a historical and political perspective that had no resemblance to that of any of the others. But with goodwill and good humor, as often as they huddled at the negotiating table, they finessed their way through their differences as they lined up their shots on the golf course and traded wisecracks on one another’s game, a style of deliberation which would eventually become the ASEAN ministerial tradition. Now, with the rigors of negotiations and the informalities of Bang Saen behind them, with their signatures neatly attached to the ASEAN Declaration, also known as the Bangkok Declaration, it was time for some formalities. The first to speak was the Philippine Secretary of Foreign Affairs, Narciso Ramos, a one-time journalist and long-time legislator who had given up a chance to be Speaker of the Philippine Congress to serve as one of his country’s first diplomats. He was then 66 years old and his only son, the future President Fidel V. Ramos, was serving with the Philippine Civic Action Group in embattled Vietnam. He recalled the tediousness of the negotiations that preceded the signing of the Declaration that “truly taxed the goodwill, the imagination, the patience and understanding of the five participating Ministers.” That ASEAN was established at all in spite of these difficulties, he said, meant that its foundations had been solidly laid. And he impressed it on the audience of diplomats, officials and media people who had witnessed the signing ceremony that a great sense of urgency had prompted the Ministers to go through all that trouble. He spoke darkly of the forces that were arrayed against the survival of the countries of Southeast Asia in those uncertain and critical times. “The fragmented economies of Southeast Asia,” he said, “(with) each country pursuing its own limited objectives and dissipating its meager resources in the overlapping or even conflicting endeavors of sister states carry the seeds of weakness in their incapacity for growth and their self-perpetuating dependence on the advanced, industrial nations. ASEAN, therefore, could marshal the still untapped potentials of this rich region through more substantial united action

What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94

We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?

Etymology explains the origin of the word itself. Example: Using the example term “arbitration”: Arbitration comes from the Latin judicium which means “judgment”. 2. History discusses the history of the term, its use, and controversies associated with it. Example: The use of arbitration as third-party mediation dates from the 1630s. 3. Cause and Effect discusses how the situation came about and what effects it may have. Example: An arbitration clause is considered to be ambiguous when the parties do not express clearly, that in case of conflict, the method to use to settle the disagreements will be arbitration. Hence, parties are compelled to refrain from signing confusing agreements to arbitrate, because the general rule is that arbitration is prompted out of the contract, and if there is not an explicit arbitration clause within the contract it would not be an agreement to arbitrate. 4. Description lists and defines the term. Example: Arbitration is the process of solving an argument between people by helping them to agree to an acceptable solution. It is the formal process of having an outside person, chosen by both sides to a disagreement to end the disagreement. 5. Principles of Operation discusses how something functions, including any special materials or conditions required. Example: Arbitration is conducted by a trained arbiter who sets down the rules that the parties must abide by. The object of arbitration is to obtain a fair resolution of disputes by an impartial third party without unnecessary expense or delay. Parties should be free to agree on how their disputes are resolved, subject only to such safeguards as are necessary for the public interest. Courts should not interfere. 5 6. Classification shows how the topic fits into a larger category. Example: Arbitration is one of the alternatives to going into a formal court to settle disputes. 7. Contrast shows how the topic differs from others in the same class. Example: In an arbitration proceeding, no lawyers are present. The main difference between arbitration and litigation law is that the court is involved in the case of litigation, as it is a lawsuit, whereas, in arbitration, a settlement between the parties is done outside of court. 8. Comparison shows how the topic is similar to others in the class. Example: As with lawsuits or other court proceedings, the decision in an arbitration proceeding is legally binding on the parties. 9. Analogy explains and compares two dissimilar topics, where the second is familiar to the audience. Example: An arbiter is like a referee–he or she listens to both sides and decides as to who is at fault, without the intervention of outside parties. 10.Examples represent other things because they have all the main qualities or characteristics that the thing they represent also have. Examples: Arbitration was used to settle the dispute between the labor union and management. Two people who are divorcing cannot agree on terms and allow a third party to come in to help them negotiate

Related quizzes

Related quizzes