The document provides an overview of effective test construction and evaluation. It discusses principles of test construction, the steps to prepare test questions, and examples of different question formats including multiple choice, true/false, matching, and essay. The presentation emphasizes designing valid and reliable assessments that accurately measure student learning.
This document discusses different types of tests including true/false, short answer, essay, and matching tests. It provides details on each type, including guidelines for constructing them and advantages/disadvantages. True/false tests can assess basic knowledge but have high guessing rates. Short answer tests reduce guessing and assess lower-level thinking but are time-consuming to score. Essay tests measure higher-order skills but are difficult to score reliably. Matching tests are easy to construct and score but often assess trivial information. Proper construction and clear guidelines are important for all test types.
Principles of test construction (10 27-2010)Omar Jacalne
The document discusses guidelines for writing different types of classroom tests, including multiple choice, true/false, matching, and short answer questions. It provides reasons for each guideline, such as avoiding confusing students with too many negatives or incomplete sentences. The document also covers Bloom's Taxonomy, which classifies learning objectives into different levels, from remembering to creating. Sample questions are provided for each level of learning, from basic recall questions to more complex questions requiring analysis, evaluation and creative thinking.
The document discusses matching type tests, which measure a learner's ability to identify relationships between sets of items. A matching type test presents two columns, with the first column (premises) numbered and the second column (responses) labeled with capital letters. It is effective for content with parallel concepts and can measure knowledge of terms and definitions, objects and labels, causes and effects, and other relationships. Advantages are objective measurement and comparing ideas, but it may overestimate learning due to guessing and be limited to lower understanding levels. The document provides rules for constructing matching type tests, such as putting more words in column A, arranging column B logically, using numbers for column A and letters for column B, and avoiding patterns in correct
This document provides guidance on constructing effective test items. It outlines a 4-step process:
1. Planning - Determine content, objectives, item types, and create a blueprint.
2. Preparing - Write items according to the blueprint. Prepare directions, administration instructions, scoring keys, and an analysis chart.
3. Try-out - Administer a preliminary and final tryout on samples to identify flaws and determine item statistics.
4. Evaluation - Analyze items based on difficulty, discrimination, consistency. Determine validity, reliability, and usability of the final test.
This document summarizes a seminar on test construction presented to faculty of BNHS-Villa Maria Annex. It discusses the importance of creating valid and reliable tests to properly evaluate student learning. Guidelines are provided for developing different test item formats, including multiple choice, true/false, matching, and essay questions. The presentation emphasizes writing clear, unambiguous questions and avoiding common pitfalls in test design to ensure tests accurately measure student understanding of course material.
Assessment of Learning - Multiple Choice TestXiTian Miran
A powerpoint presentation about the Multiple Choice Test as one of the assessment strategies that can be used by teachers in assessing learners. Also, this includes the introduction, definition, advantages, and limitations of Multiple Choice Test.
The document discusses different forms of student assessment:
1. Standardized tests and teacher-made tests assess lower-level thinking but are objective to score and easy to administer. However, they are time-consuming to prepare and prone to cheating.
2. Practical tests, oral tests, and projects require demonstrating skills or creating products and are relatively easy to prepare. They measure behaviors that cannot be deceived but scoring is subjective without rubrics and administration is time-consuming.
3. Portfolios show student growth and development over time in an intelligence-fair way but require significant time to develop and ratings can be subjective without rubrics.
This document discusses student learning outcomes (SLOs) and their importance in guiding teaching and assessment. It states that clearly defined SLOs help both teachers and students understand what is expected for success. All assessment activities should begin with identifying and clarifying SLOs, as they serve as guidelines. SLOs come from various sources like an institution's mission, government standards, professional competencies, and general education competencies. Defining SLOs ensures graduates can meet expectations in their future work or studies.
The document discusses the process of developing a table of specifications (TOS) for assessment instruments. It defines a TOS as a table that aligns objectives, instruction, and assessment. The purpose of a TOS is to guide what topics should be included and how many items should assess each level. To prepare a TOS, teachers select learning outcomes, outline subject matter, decide on items per subtopic, and create a two-way chart listing objectives, class time spent, percentages, number of items, and item specifications based on Bloom's taxonomy. Tips for the TOS include avoiding excessive detail, focusing on major ideas, choosing an appropriate cognitive taxonomy, and weighing the distribution against student level and test constraints.
The document provides guidelines for constructing different types of test questions including matching, sentence completion, essay, and other question types. It discusses principles such as ensuring questions are clear, focused, and at an appropriate level for students. The document emphasizes that creating good tests takes time but plays an important role in evaluation. It also notes that breaking rules is acceptable when one has a good reason.
This document discusses authentic assessment, including its meaning, characteristics, and phases. Authentic assessment measures meaningful accomplishments compared to standardized tests and involves tasks that demonstrate application of knowledge and skills. It is criterion-referenced, emphasizes performance over recall, and encourages students to take an active role in the assessment process. The phases of authentic assessment include identifying important outcomes, setting criteria and standards, implementing supporting activities, measuring outcome attainment, and evaluating results for continuous improvement. Examples provided are science experiments, field research, writing assignments, and skill demonstrations.
The document discusses item analysis which is used to evaluate the quality and performance of test items. It addresses several key aspects of item analysis including calculating the index of difficulty and discrimination for each item, examining distractors, and using the results to identify issues and determine if items should be retained, modified, or discarded. The purpose is to select the best items for the final test form and identify areas for improvement.
Criterion and Norm - Referenced Interpretations and the Four Frames of ReferenceMr. Ronald Quileste, PhD
This presentation is all about knowing Criterion and Norm-referenced interpretations. This presentation will give you an idea when are tests considered needing criterion or norm-referenced descriptions. The four frames of reference are also discussed here. Assessment of Learning 1 Lesson
The document discusses key concepts related to student assessment including:
1) It defines terms like assessment, evaluation, measurement, formative assessment, placement assessment, diagnostic assessment, and summative assessment.
2) It differentiates between assessment, testing, measurement, and evaluation.
3) It discusses the purposes of assessment and the roles of assessment in instructional decisions.
4) It compares different types of assessment like diagnostic versus placement, and norm-referenced versus criterion-referenced.
5) It provides details on specific assessment methods like portfolios, performances, and guidelines for effective student assessment.
The document outlines an agenda for a workshop on test construction. It includes times for discussion, breaks, preparation, and different activities like a test construction workshop, critiquing by groups, and presentations. It also includes concepts like the cognitive process dimensions, different levels of assessment and proficiency, and examples of knowledge, process and understanding test questions. The workshop aims to help participants design effective assessment tools that evaluate different cognitive levels based on revised Bloom's taxonomy.
Holistic grading methods evaluate essays as a whole rather than as a sum of parts. A holistic scoring rubric describes the characteristics of excellent, good, and weaker essays. An excellent essay clearly states a position, provides original evidence to support it and refute counterarguments, and makes relationships between ideas clear. A good essay also states a position and addresses counterarguments but may have minor issues. Weaker essays have problems like lack of evidence, organization, or addressing counterarguments.
This document discusses guidelines for constructing various assessment tools, including true-false tests, multiple choice tests, matching tests, and essays. For true-false tests, it provides tips like avoiding absolute terms and trick questions. For multiple choice, it recommends making distractors plausible and consistent with the stem. Matching tests involve matching items in two columns; guidelines include using capital letters and ensuring fewer responses than premises. When constructing essays, the document advises providing clear directions and criteria for grading.
This document provides guidance on effective test construction for teachers. It discusses the importance of evaluation and outlines steps for constructing valid, reliable and usable tests. These include preparing a table of specifications to relate learning outcomes to content, writing clear questions at appropriate cognitive levels, and using formats like multiple choice and situational judgement tests. Key points are that good tests take work but are essential for student and teacher development, and breaking rules can be acceptable with good reason. The overall message is that effective evaluation requires understanding content and students.
Assessment gathers information about students to understand them, while evaluation places judgment and assigns grades. There are two purposes of assessment: to provide feedback to students and diagnose instruction. Formative assessment assists teaching before and during instruction, while summative assessment evaluates after instruction. Alternative assessments like projects, performances, and portfolios can be used in addition to traditional tests. Rubrics are detailed descriptions of performance criteria that are used to score student work.
The document provides information about microteaching, which is a technique used to improve teaching skills. It involves practicing specific skills in short lessons that are video recorded and reviewed. The microteaching cycle includes planning a short lesson, presenting while recorded, viewing the recording with peers, discussing strengths and areas for improvement, summarizing suggestions, and re-planning the lesson based on the feedback. Ten specific teaching skills are identified that can be practiced through microteaching, including planning, questioning techniques, exemplifying content, and summarizing lessons.
The document did not contain any text to summarize. Summarizing requires analyzing the content and ideas within a document to extract the most important and relevant information, but this document only contained the letters "WR" and did not provide enough context for a meaningful summary.
The presentation provided guidance on developing effective classroom tests through the use of tables of specification to map learning objectives and content, following best practices for question types like multiple choice and situational judgment tests, and emphasizing the importance of validity, reliability and usability in assessment. Effective test construction requires understanding students, having subject mastery, and developing questions that accurately measure learning outcomes.
Table of Specifications (TOS) and Test Construction ReviewRivera Arnel
The presentation provided an overview of test construction and highlighted the importance of creating a table of specifications to ensure tests adequately sample the intended learning outcomes. It also discussed guidelines for writing different types of test items like multiple choice and situational judgment questions, emphasizing the need for clarity, relevance, and avoiding flaws that could introduce errors. Effective test development requires understanding cognitive taxonomies and applying principles of validity, reliability, and usability.
The document discusses effective assessment tools for higher education. It emphasizes that assessment should ensure all students succeed, be a celebration of learning, and assess students fairly from all aspects. Assessment tools should simulate real-world problems, guide effective learning approaches, and measure expected outcomes. Both traditional and authentic forms of assessment are described, along with examples of creating test questions and applying Bloom's taxonomy to assess different cognitive, affective, and social domains.
The document discusses Bloom's Revised Taxonomy, a framework for categorizing levels of thinking skills. It provides an overview of the original taxonomy developed in the 1950s and revisions made in the 1990s. The revisions include changing the categories from nouns to verbs and emphasizing explanation over memorization. The taxonomy helps teachers design lessons and assessments that engage students at different levels of thinking from remembering to creating.
Testing teacher's hand testing & examiner guide 2018Mr Bounab Samir
This document provides guidance for exam designers and teachers on developing effective assessments. It discusses the purposes of testing, such as evaluating student learning and motivating students. It also provides recommendations for exam designers, such as ensuring exams align with curriculum objectives and competencies. The document then describes different types of test questions and provides tips for planning exams, such as writing questions throughout the term, including a variety of question types, and testing the timing. Overall, the document aims to help exam designers and teachers create assessments that effectively measure student learning.
Learning Success Center - Supplemental Education Service Training 2011-12 Robert Blake
The document provides information about supplemental education services training provided by the Learning Success Center (LSC) in 2011-12. It outlines that LSC will provide an on-site coordinator and site monitor to oversee programs. It also lists expectations for teachers, including being prepared with lesson plans and materials, following training procedures, and notifying LSC of any issues. Teachers are expected to complete and submit required paperwork in a timely manner.
This document discusses Bloom's Taxonomy and its revision, which categorizes different types of learning objectives from simple recall to evaluation. It also discusses essential questions, which spark curiosity and require students to construct their own answers. Finally, it explains Understanding by Design, an instructional framework that begins with identifying desired learning outcomes and designing assessments to measure student understanding.
Testing & examiner guide 2018 teacher's hand out oued semar a lgiersMr Bounab Samir
The document provides guidance for developing effective exams and assessments. It discusses the purposes of testing, such as evaluating student learning and motivating students. It also outlines recommendations for exam designers, such as ensuring exams align with curriculum objectives and competencies. The document then describes different types of test questions and provides tips for constructing exams, including writing clear instructions, balancing easy and difficult questions, and testing timing. Overall, the summary emphasizes the importance of exams reflecting curriculum goals and being designed to effectively measure student learning.
This document discusses performance assessments and provides examples. Performance assessments evaluate students' ability to perform tasks by producing their own work using their knowledge and skills. They require students to apply deep understanding and reasoning skills. Examples include singing, playing an instrument, or completing a project. Performance assessments integrate assessment with instruction, provide opportunities for formative feedback, and are more authentic and engaging for students. However, they can be difficult to score reliably and require significant time from teachers and students. The document also discusses process-oriented performance assessments, which evaluate the process students undergo rather than just the final product or output.
Process orientedperformance-basedassessmentjabello glaiza
This document defines performance assessment and discusses its characteristics and strengths/weaknesses. Performance assessment involves observing students demonstrate skills or competencies through tasks like projects, presentations, or performances. It emphasizes applying knowledge rather than just recalling facts. While more authentic than traditional tests, performance assessment relies on subjective scoring and takes significant time from teachers and students. The document also discusses process-oriented performance assessments, which evaluate the process used to complete tasks in addition to products or outputs. This includes developing rubrics that establish criteria and define competency levels for skills.
The document provides 8 steps to academic success: 1) Set goals, 2) Have a positive attitude, 3) Manage your time, 4) Read textbooks and course readings, 5) Attend lectures, 6) Record lecture notes, 7) Prepare for exams, and 8) Seek help from instructors when needed. It emphasizes the importance of time management, active reading and note-taking, as well as preparing thoroughly for exams to achieve academic success.
1. The document provides guidance for teachers on developing effective classroom tests. It discusses important test design principles such as validity, reliability, usability, and ensuring questions align with learning outcomes.
2. Specific recommendations are given for writing different types of test questions, such as multiple choice, true/false, and situational judgement questions. Key points include using unambiguous language, avoiding trick questions, and making all options comparable.
3. Developing high-quality tests takes time but plays an important role in student and teacher evaluation. Teachers should focus on testing key concepts and follow best practices, while allowing flexibility when needed.
This document discusses different forms of assessment in mathematics education. It begins by defining the DepEd taxonomy of knowledge, process, understanding and product/performance. It then provides examples of mathematics skills and asks the reader to determine which category each one falls into. The document then discusses performance-based assessment and alternative forms such as portfolios. It provides characteristics of performance tasks and guidelines for constructing rubrics. Overall, the document aims to distinguish different types of assessment and provide information about designing performance-based tasks and rubrics.
The document discusses different methods of summative assessment used to evaluate student learning and success in meeting intended learning outcomes. It provides examples of summative assessment types like exams, tests, essays, reports and presentations. It also discusses considerations around assessing creative practical projects and using qualitative assessment with holistic judgement. The document advocates for aligning assessment methods with learning outcomes and considering multiple assessment types.
Culture is a social heritage transmitted between generations consisting of skills, beliefs, knowledge and products shared by a group. It is learned and based on symbols that are shared and integrated into a pattern. Cultures generally adapt to their environments to make communication possible, provide standards, skills for survival, and a sense of belonging. Culture includes both material aspects like tools and houses as well as non-material aspects like traditions and beliefs.
Region 1, also known as the Ilocos Region, is located in northern Luzon, Philippines. It has a total area of 13,055 sq km and a population of over 4.5 million people. The region is composed of 4 provinces - Ilocos Norte, Ilocos Sur, La Union, and Pangasinan. The primary languages are Ilocano and other regional dialects. The economy is based on agriculture including crops like rice, corn, tobacco as well as industries like fishing, manufacturing, and tourism which features historical sites, beaches, and natural attractions across the provinces.
The document summarizes key aspects of Article XV of the Philippine constitution regarding the family. It defines the family and describes its importance as the foundation of society. The state has a duty to strengthen and promote the solidarity of families. Children have rights to care, nutrition, and protection from abuse. Families have rights to a living wage, and participation in policies affecting them. The elderly also have a right to care and support from both family and social security programs established by law.
The document summarizes key aspects of the Philippine constitution and government based on the 1987 constitution. It outlines that the Philippines has a democratic and republican form of government where sovereignty resides with the people. It describes the bill of rights and individual freedoms guaranteed in the constitution. It also discusses the purpose and structure of the Philippine constitution.
A business plan is a document that describes a company's goals, strategies, and finances. It has three primary parts: the business concept, marketplace analysis, and financial projections. The business concept discusses the industry, product/service, and plans for success. The marketplace section analyzes customers and competition. The financial section includes income statements, cash flow forecasts, and break-even analysis. A good business plan is concise, convincing, and complete to attract investors and guide the business execution.
Laws are rules established to govern relations between people in society. They must be just, obligatory, promulgated by legitimate authority, and for the common benefit. The Constitution is the fundamental law that binds the government and people. Supreme Court decisions establish jurisprudence that lower courts must follow under stare decisis. Religious freedom is protected, so students cannot be compelled to attend flag ceremonies against their beliefs.
Political science is defined as the study of the state and government. It analyzes the stages of studying political science from a religious to a modern stage. Key figures like Aristotle and Machiavelli contributed to the development of political science. A state is defined as a group of people occupying a definite territory with an independent government and sovereignty. The difference between a nation and a state is that a nation refers to a ethnic or racial group, while a state is a legal concept. Citizenship can be changed but nationality is absolute and innate.
Sociology is the study of human society and social behavior. It examines how societies are structured and how social relationships, groups, and institutions affect human behavior. A society can be defined as a group of humans who share common interests and culture. Socialization is the lifelong process by which people learn the patterns of their culture and develop their human potential through social interaction and experience. Effective communication involves expressing ideas, feelings, opinions, and emotions to develop intimacy and understanding between individuals. A society establishes social structures like hierarchies, roles, norms, values and rules of behavior to maintain order and stability.
Anthropology is the study of humans, human behavior, and societies in both past and present. It seeks to understand the diversity of humans and how and why they differ physically and culturally. There are four main fields of anthropology: biological anthropology, which studies human populations and evolution using an evolutionary framework; archaeology, which seeks to reconstruct past human cultures; cultural anthropology/ethnography, which aims to understand cultural variation across societies; and linguistic anthropology, which examines human language and communication and how it relates to culture.
This document introduces the concept of culture in anthropology. It defines culture as a social heritage transmitted between generations, consisting of skills, beliefs, knowledge and products shared by a group. Culture can be material, like tools and clothing, or non-material, like symbols and traditions. All cultures share key characteristics - culture is learned, based on symbols, shared within groups, integrated and patterned, and generally adaptive. Culture provides a way for groups to communicate, differentiate right from wrong, survive, and feel a sense of belonging.
Still I Rise by Maya Angelou
-Table of Contents
● Questions to be Addressed
● Introduction
● About the Author
● Analysis
● Key Literary Devices Used in the Poem
1. Simile
2. Metaphor
3. Repetition
4. Rhetorical Question
5. Structure and Form
6. Imagery
7. Symbolism
● Conclusion
● References
-Questions to be Addressed
1. How does the meaning of the poem evolve as we progress through each stanza?
2. How do similes and metaphors enhance the imagery in "Still I Rise"?
3. What effect does the repetition of certain phrases have on the overall tone of the poem?
4. How does Maya Angelou use symbolism to convey her message of resilience and empowerment?
AI Risk Management: ISO/IEC 42001, the EU AI Act, and ISO/IEC 23894PECB
As artificial intelligence continues to evolve, understanding the complexities and regulations regarding AI risk management is more crucial than ever.
Amongst others, the webinar covers:
• ISO/IEC 42001 standard, which provides guidelines for establishing, implementing, maintaining, and continually improving AI management systems within organizations
• insights into the European Union's landmark legislative proposal aimed at regulating AI
• framework and methodologies prescribed by ISO/IEC 23894 for identifying, assessing, and mitigating risks associated with AI systems
Presenters:
Miriama Podskubova - Attorney at Law
Miriama is a seasoned lawyer with over a decade of experience. She specializes in commercial law, focusing on transactions, venture capital investments, IT, digital law, and cybersecurity, areas she was drawn to through her legal practice. Alongside preparing contract and project documentation, she ensures the correct interpretation and application of European legal regulations in these fields. Beyond client projects, she frequently speaks at conferences on cybersecurity, online privacy protection, and the increasingly pertinent topic of AI regulation. As a registered advocate of Slovak bar, certified data privacy professional in the European Union (CIPP/e) and a member of the international association ELA, she helps both tech-focused startups and entrepreneurs, as well as international chains, to properly set up their business operations.
Callum Wright - Founder and Lead Consultant Founder and Lead Consultant
Callum Wright is a seasoned cybersecurity, privacy and AI governance expert. With over a decade of experience, he has dedicated his career to protecting digital assets, ensuring data privacy, and establishing ethical AI governance frameworks. His diverse background includes significant roles in security architecture, AI governance, risk consulting, and privacy management across various industries, thorough testing, and successful implementation, he has consistently delivered exceptional results.
Throughout his career, he has taken on multifaceted roles, from leading technical project management teams to owning solutions that drive operational excellence. His conscientious and proactive approach is unwavering, whether he is working independently or collaboratively within a team. His ability to connect with colleagues on a personal level underscores his commitment to fostering a harmonious and productive workplace environment.
Date: June 26, 2024
Tags: ISO/IEC 42001, Artificial Intelligence, EU AI Act, ISO/IEC 23894
-------------------------------------------------------------------------------
Find out more about ISO training and certification services
Training: ISO/IEC 42001 Artificial Intelligence Management System - EN | PECB
Webinars: https://pecb.com/webinars
Article: https://pecb.com/article
-------------------------------------------------------------------------------
Credit limit improvement system in odoo 17Celine George
In Odoo 17, confirmed and uninvoiced sales orders are now factored into a partner's total receivables. As a result, the credit limit warning system now considers this updated calculation, leading to more accurate and effective credit management.
The Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdfJackieSparrow3
we may assume that God created the cosmos to be his great temple, in which he rested after his creative work. Nevertheless, his special revelatory presence did not fill the entire earth yet, since it was his intention that his human vice-regent, whom he installed in the garden sanctuary, would extend worldwide the boundaries of that sanctuary and of God’s presence. Adam, of course, disobeyed this mandate, so that humanity no longer enjoyed God’s presence in the little localized garden. Consequently, the entire earth became infected with sin and idolatry in a way it had not been previously before the fall, while yet in its still imperfect newly created state. Therefore, the various expressions about God being unable to inhabit earthly structures are best understood, at least in part, by realizing that the old order and sanctuary have been tainted with sin and must be cleansed and recreated before God’s Shekinah presence, formerly limited to heaven and the holy of holies, can dwell universally throughout creation
Principles of Roods Approach!!!!!!!.pptxibtesaam huma
Principles of Rood’s Approach
Treatment technique used in physiotherapy for neurological patients which aids them to recover and improve quality of life
Facilitatory techniques
Inhibitory techniques
How to Show Sample Data in Tree and Kanban View in Odoo 17Celine George
In Odoo 17, sample data serves as a valuable resource for users seeking to familiarize themselves with the functionalities and capabilities of the software prior to integrating their own information. In this slide we are going to discuss about how to show sample data to a tree view and a kanban view.
Slide Presentation from a Doctoral Virtual Open House presented on June 30, 2024 by staff and faculty of Capitol Technology University
Covers degrees offered, program details, tuition, financial aid and the application process.
How to Configure Time Off Types in Odoo 17Celine George
Now we can take look into how to configure time off types in odoo 17 through this slide. Time-off types are used to grant or request different types of leave. Only then the authorities will have a clear view or a clear understanding of what kind of leave the employee is taking.
Front Desk Management in the Odoo 17 ERPCeline George
Front desk officers are responsible for taking care of guests and customers. Their work mainly involves interacting with customers and business partners, either in person or through phone calls.
Integrated Marketing Communications (IMC)- Concept, Features, Elements, Role of advertising in IMC
Advertising: Concept, Features, Evolution of Advertising, Active Participants, Benefits of advertising to Business firms and consumers.
Classification of advertising: Geographic, Media, Target audience and Functions.
1. TEST
CONSTRUCTION
The Art of Effective Evaluation
Presented to the Faculty
and Students of UPHSD –
Molino Campus
Presented by:
Arnel O. Rivera
http://www.slideshare.net/ArnelSSI
3. Bruce Lee, the legendary
martial artist, once told a
story about a highly-
educated man who went
to a Zen teacher to ask
and acquire knowledge
about Zen.
4. As the Zen teacher began
to explain things, the man
would frequently interrupt
with remarks like, "Oh,
yes, we have that too…”
5. Finally the Zen teacher
stopped talking. He began
to serve tea. He poured
tea into the man’s cup.
6. He poured tea into the cup
until it was full, and then
kept pouring until the cup
overflowed. "Enough!" the
man once more
interrupted, "No more can
go into the cup!"
7. “Indeed, I see," answered the Zen teacher, "If
you do not first empty the cup, how can you
taste my cup of tea?"
8. A full cup cannot accept
anything more. Similarly,
a person who believes
that he had learnt a lot
cannot learn anything
else & will stagnate
quickly and not move to
higher levels.
WWW.SIMILIMA.COM
11. 13% of students who got low
grades in exams are caused
by faulty test questions.
WORLDWATCH
The Philadelphia Trumpet
August 2005
12. It is estimated that 90% of all test
questions asked in the US are of
“Low level” - knowledge and
comprehension.
(Wilen, W.W., 1992)
13. “Low level” doesn’t mean easy:
Write an essay explaining the decline and
fall of the Roman Empire incorporating at
least five of the seven causes discussed in
class from the writings of Gibbon and
Toynbee
“High level” doesn’t mean hard:
Which movie did you like more, WALL-E or
Cars? Why?
15. Outline:
Principles in Test Preparing Matching
Construction Type Questions
Steps in Preparing Preparing Sentence
Test Questions Completion Questions
Preparing Multiple Preparing Essay
Questions
Choice Questions
Other types of Test
Preparing True or Questions
False Questions
Wrap-up/Things to
Remember
16. “The evaluation of pupils’
progress is a major aspect of
the teacher’s job.“
Evaluating Educational Outcomes
(Oriondo & Antonio)
18. Our students were trained
to memorize information.
After they have memorized
facts, then what?
19. Old belief about teaching .....
Education is a process where the
notes of the teachers or the
contents in the books are
transfered to the notebooks of
the students, without
understanding them.
(Wiggins, 2009)
20. In your lesson plans, did you
ever bother to ask this
question:
• How do you know if
you have achieved
your desired result?
21. What is testing?
“A test is a sample of behavior, products, answers, or
performances from a particular domain” (Carrington, 1994)
“… it's a systematic method of eliciting performance which is intended
to be the basis for some sort of decision making" (Hughes, 1989).
“A test will predict performance levels, and the learner will somehow
reconstruct its parts in meaningful situations when necessary”
(McCann, 2000)
“ Testing is generally concerned with turning performance into
numbers.” (Baxter, 1997)
Guidelines for Test Construction
22. What are tests for?
Inform learners and teachers of the strengths and
weaknesses of the process
Motivate learners to review or consolidate specific material
Guide the planning/development of the ongoing teaching
process
Create a sense of accomplishment
Determine if the objectives
have been achieved
Encourage improvement
Guidelines for Test Construction
24. BARRIERS IN TEST CONSTRUCTION
Ms. Alanganin – confusing statements
Mr. Highfalutin – difficult vocabulary
Ms. Madaldal – excessive wordiness
Ms. Magulo – complex sentence structure
Ms. Malabo – unclear instructions
Mr. Pulpol – unclear illustrative materials
Ms. Foringer – linguistically bound words
Ms. Colonial Mentality – culturally bound words
25. Characteristics of Good Tests
Validity – the extent to which the
test measures what it intends to
measure
Reliability – the consistency with
which a test measures what it is
supposed to measure
Usability – the test can be
administered with ease, clarity
and uniformity
26. Other Things to Consider
Scorability – easy to score
Interpretability – test results can
be properly interpreted and is a
major basis in making sound
educational decisions
Economical – the test can be
reused without compromising the
validity and reliability
27. “To be able to prepare a good
test, one has to have a
mastery of the subject
matter, knowledge of the
pupils to be tested, skill in
verbal expression and the
use of the different test
format”
Evaluating Educational Outcomes
(Oriondo & Antonio)
28. 5 Most Commonly used
Test Format
1. Multiple Choice
2. True or False
3. Matching Type
4. Fill-in the blanks (Sentence Completion)
5. Essay
Source: Turn-out of Test Questions in SSI (2003-2007)
29. General Steps in Test Construction
DRAFT
PRODUCE A
T.O.S.
ORDER
TEST ANALYZE
SUBMISSION
30. Table of Specifications (TOS)
A two way chart that relates the
learning outcomes to the course
content
It enables the teacher to prepare a test
containing a representative sample of
student behavior in each of the areas
tested.
32. Tips in Preparing the Table
of Specifications (TOS)
Don’t make it overly detailed.
It's best to identify major ideas and skills
rather than specific details.
Use a cognitive taxonomy that is most
appropriate to your discipline, including non-
specific skills like communication skills or
graphic skills or computational skills if such
are important to your evaluation of the
answer.
33. Tips in Preparing the Table
of Specifications (TOS)
Weigh the appropriateness of the distribution
of checks against the students' level, the
importance of the test, the amount of time
available.
MATCH the question level appropriate to the
level of thinking skills
34. Examples of Student Activities and Verbs
for Bloom’s Cognitive Levels (Jacobs &
Chase, 1992:19)
Bloom’s Cognitive Student Activity Words to Use in Item
Level Stem
Knowledge Remembering facts, Define, list, state,
terms, concepts, identify, label, name,
definitions, principles who?, when?, where?,
what?
Comprehension Explaining/interpreting Explain, predict, interpret,
the meaning of material infer, summarize, convert,
translate, account for,
give example, paraphrase
Application Using a concept or Apply, solve, show, make
principle to solve a use of, modify,
problem demonstrate, compute
35. Examples of Student Activities and Verbs for
Bloom’s Cognitive Levels (Jacobs & Chase,
1992:19)
Bloom’s Cognitive Student Activity Words to Use in Item
Level Stem
Analysis Breaking material down Differentiate,
into its component parts to compare/contrast,
see interrelationships/ distinguish ____from
hierarchy of ideas ____, how does
____relate to ___, why
does ____work
Synthesis Producing something new or Design, construct, develop,
original from component formulate, imagine,
parts create, change, write a
poem or short story
Evaluation Making a judgment based Appraise, evaluate,
on a pre-established set of justify, judge, which would
criteria be better?
36. Tips in Preparing the Table
of Specifications (TOS)
The following array shows the most common
questions types used at various cognitive
levels.
Factual Knowledge Application Analysis and
Evaluation
Multiple Choice Multiple Choice Multiple Choice
True/False Short Answer Essay
Matching Type Problems
S. Completion Essay
Short Answer/RRT
37. General Rules in Writing Test
Questions
Number test questions continuously.
Keep your test question in each test group
uniform.
Make your layout presentable.
Do not put too many test questions in one
test group.
T or F: 10 – 15 questions
Multiple Choice: max. of 30 questions
Matching type: 5 questions per test group
Others: 5 – 10 questions
38. Some additional guidelines to consider
when writing items are described below:
1. Avoid humorous items. Classroom testing is
very important and humorous items may
cause students to either not take the exam
seriously, become confused or anxious.
2. Items should measure one’s knowledge of the
item context not their level of interest.
3. Write items to measure what students know,
not what they do not know. (Cohen & Wallack)
40. What to Look for on
Multiple Choice Tests
When checking the stems for correctness:
Ensure that the stem asks a clear
question.
Reading level is appropriate to the
students
The stem is grammatically correct.
Negatively stated stems are
discouraged.
41. Anatomy of a Perfect
Multiple Choice Tests
Example:
What is the effect of releasing a ball in
positive gravity?
a) It will fall “down.” correct
b) It will retain its mass. true but unrelated
c) It will rise. false but related
d) Its shape will change. false and unrelated
42. Multiple Choice Questions
1. Use negatively stated stems sparingly and
when using negatives such as NOT,
underline or bold the print.
2. Use none of the above and all of the above
sparingly, and when you do use them, don't
always make them the right answer.
3. Only one option should be correct or clearly
best.
43. Multiple Choice Questions:
4. All options should be homogenous and
nearly equal in length.
5. The stem (question) should contain only
one main idea.
6. Keep all options either singular or plural.
7. Have four or five responses per stem
(question).
44. Multiple Choice Questions:
7. When using incomplete statements place
the blank space at the end.
8. When possible organize the responses.
9. Reduce wordiness.
10. When writing distracters, think of incorrect
responses that students might make.
45. Examples
1. Sheldon developed a highly controversial
theory of personality based on body type and
temperament of the individual. Which of the
following is a criticism of Sheldon's work?
a. He was influenced too much by the
Freudian psychoanalysis.
b. His rating of physique and temperament
were not independent.
c. He failed to use empirical approach.
d. His research sample was improperly
selected.
46. Examples
Better: (Eliminate excessive wording and
irrelevant information)
1. Which of the following is a criticism of
Sheldon's theory of personality?
47. Examples
1. The receptors for the vestibular sense
are located
a. in the fovea.
b. in the brain.
c. in the middle ear.
d. in the inner ear.
48. Examples
Better: (Include in the stem any word(s) that
might otherwise be repeated in each
option.)
1. The receptors for the vestibular senses are
located in the _______.
a. fovea
b. brain
c. middle ear
d. inner ear
50. What to Look for on
True/False Tests
Each statement is clearly true or
clearly false.
Trivial details should not make a
statement false.
Statements are written concisely
without more elaboration than
necessary.
Statements are NOT quoted exactly
from text.
51. Tips in Making True/False Tests
Give emphasis on the use of quantitative
terms than qualitative terms.
Avoid using of specific determiners which
usually gives a clue to the answer.
False = all, always, never, every, none,
only
True = generally, sometimes, usually,
maybe, often
Discourage the use of negative
statements.
Whenever a controversial statement is
used, the authority should be quoted.
Discourage the use of pattern for answers.
52. Examples:
Find the errors, and/or problems with the
following true-false tests.
____ 1. Repetition always strengthens the
tendency for a response to occur.
(Using "always" usually means the answer
is false.)
53. Examples:
_____ 2. The process of extinction is
seldom immediate but extends
over a number of trials.
(Words like "seldom" usually indicate a
true statement.)
54. Examples:
_____ 3. The mean, median, and mode are
measures of central tendency,
whereas the standard deviation and
range are measures of variability.
(Express a single idea in each statement.)
e.g.“The mean and standard
deviation are measures of central
tendency.”
56. Parts of the Matching Type Test
(Vertical Type)
Column A Column B
(Premise) (Response)
57. Parts of the Matching Type Test
(Horizontal Type)
(Response)
(Premise)
58. What to Look for on
Matching Type Tests
The list of responses should be
relatively short.
Response options should be arranged
alphabetically or numerically.
Directions clearly indicate the basis for
matching.
Can responses be used more than once?
Where will you place your answer?
Can students infer relationships or are
they based on real word logic?
59. What to Look for on
Matching Type Tests
Position of matches should be varied.
Avoid using patterns.
The choices of each matching set
should be on one page
There are more responses than
premises in a single set if responses
cannot be used more than once.
60. What to Look for on
Matching Type Tests
The premises are homogeneous as well
as the responses and are grouped as
one item.
Example:
Set A: Provinces in Region I
Set B: Provinces in CAR
If responses can be used more than
once, it should be proportional to the
number of premises (3:5 or 4:10)
61. Examples:
Directions: Match the following.
1. Food A. Primary reinforcer
2. Psychoanalysis B. Sigmund Freud
3. B.F. Skinner C. Operant conditioning
4. Standard deviation D. Measure of variability
5. Schizophrenia E. Hallucinations
62. Examples:
Better: (Use homogenous material in matching items, and
if responses are not to be used more than once, include
more responses than stimuli.)
Match the theories in Column A with their proponents in
Column B. Write the letter of the correct answer.
Column A Column B
___ 1. Psychodynamic Theory A. Albert Bandura
___ 2. Trait Theory B. B.F. Skinner
___ 3. Behaviorism C. Carl Rogers
___ 4. Humanism D. Gordon Allport
___ 5. Social Learning Theory E. Karn Horney
F. Raymond Cattell
G. Sigmund Freud
64. What to Look for on
Sentence Completion Tests
Only significant words are omitted.
When omitting words, enough clues are
left so that the student who knows the
correct answer can supply the correct
response.
Ensure that grammatical clues are
avoided.
65. What to Look for on
Sentence Completion Tests
Blanks are at the end of the statement.
The length of the responses are limited
to single words or short phrases.
Questions are not lifted as verbatim
quotes from text.
66. Examples:
1. An animal with six legs is called _________.
The item is so indefinite.It can be completed with
answers such as bee, mosquito or any other
insect
Better:
1. Animals with six legs are called ___________.
67. Examples:
1.The __________ is the answer in _____.
Too many key words are omitted. Lines are
not in equal length.
Better:
1. The product is the answers in _________.
68. Examples:
1. If a mango weighs 250 grams, 10 mangoes
would weigh ______.
There are two possible answers – 250 grams
and .25 kilos.
Better:
1. If a mango weighs 250 grams, 10 mangoes
would weigh ____ grams.
70. Types of Essay Items:
Extended response type
The test may be answered by the
examinee in whatever manner he wants
Example: Do you think teachers should be
allowed to work abroad as domestic
helpers? Explain your answer.
71. Two Types of Essay Items:
Restricted response type
The test limits the examinees response
may be answered by the examinee’s
responses in terms of length, content,
style or organization.
Example: Give and explain three reasons
why the government should or should not
allow teachers to work abroad as domestic
helpers.
72. What to Look for on
Essay Tests
The task is clearly defined. The
students are given an idea on the scope
and direction you intended for the
answer to take. The question starts
with a description of the required
behavior to put them in the correct mind
frame.
E.g. “Compare” or “Analyze”
73. What to Look for on
Essay Tests
The questions are written in the
linguistic level appropriate to the
students.
Questions require a student to
demonstrate command of background
information, not simply repeating
information.
74. What to Look for on
Essay Tests
Questions regarding a student’s opinion
on a certain issue should focus not on
the opinion but on the way it is
presented and argued.
A larger number of shorter, more
specific questions are better, than, one
or two longer questions.
75. Proposed Criteria in Grading
Essay Test
Ideas (20%)
Weight of Evidence Presented (40%)
Correct Usage (20%)
Logical Conclusions drawn from the
evidence (20%)
76. Example:
What is wrong with this question?
Describe asthma?
Better: (Clearly explain what is expected of
the student.)
Describe asthma. Include in your answer :
a. the pathophysiologic features of asthma
b. the clinical manifestations associated with
an asthma episode
c. the management of an asthma episode.
(10 points)
77. Example:
What is wrong with this question?
Who is better, Rizal or Bonifacio?
Better: ( The students are given an idea on
the scope and direction you intended for the
answer to take.)
Compare and contrast the method used by
Rizal and Bonifacio in promoting
nationalism. (5 points)
79. Restricted Response Test (RRT)
Test takers are not given choices as possible
answers. Items ask for a specific answer to
each questions.
Example:
Who discovered the Philippines?
What are the four elements of the state?
80. Principles in constructing RRT
Do not ask for trivial facts or details. It is not
only useless but also frustrates the students.
How many balls are used in a 9-ball match?
Questions should elicit facts not opinions?
What do you think Pres. GMA should do for the
country to recover from its’ economic deficit?
Minimize questions that call for sheer
memory work unless if the answer has
important analytical significance.
When will the next president be sworn to office?
81. Chronological Sequencing Test (CST)
Test takers are asked to arrange items
in a systematic or logical order.
Arrange the presidents according to their
term of office.
_____ Fidel Ramos
_____ Joseph Estrada
_____ Corazon Aquino
_____ Gloria Macapagal - Arroyo
82. Principles in constructing CST
Items should be homogenous and are related
to each other.
There should not be more than 5 items in
each set.
Do not number the items. This confuses the
students.
All items to be arranged should be in the
same page.
Directions should be clearly stated and that
each set should be labeled about their
relevance.
83. What is wrong in this test question?
Arrange the following events in their
chronological order.
1. Bataan Surrenders
2. The Japanese attacks the US fleet in Pearl
Harbor, Hawaii.
3. Hitler invades Poland
4. The US declares war with Japan.
5. Gen. MacArthur escapes to Australia.
84. Better:
21-25.) War in the Pacific
Arrange the following events in chronological order.
Write the numbers 1-5 on the blanks provided.
___ USAFEE forces in Bataan surrender to the Japanese.
___ Japanese forces attacks the US fleet in Pearl Harbor,
Hawaii.
___ Japan breaks diplomatic ties with the US.
___ The US declares war with Japan.
___ Gen. MacArthur escapes to Australia from Corregidor.
85. Proposed Arrangement of Test Items
True or False
Multiple Choice
Matching Type
Sentence Completion
Others (RRT/Analogy/CST)
Essay
86. Things to Remember:
Making a good test takes time
Teachers have the obligation to
provide their students with the
best evaluation
Tests play an essential role in the
life of the students, parents,
teachers and other educators
Break any of the rules when
you have a good reason for
doing so! (emphasis mine)
(Mehrens, 1973)
87. POINTS TO PONDER…
A good lesson makes a good question
A good question makes a good content
A good content makes a good test
A good test makes a good grade
A good grade makes a good student
A good student makes a good COMMUNITY
Jesus Ochave Ph.D.
VP Research Planning & Development
Philippine Normal University
88. For questions , comments or if you
want to download this file, log-on to:
http://www.slideshare.net/ArnelSSI