It’s been some time now since there’s been a buzz about a new version of the Architect Registration Examination® (ARE®), with ARE 5.0 being launched in late 2016. And while many candidates have familiarized themselves with NCARB’s study resources and tools, some are still left with questions about the content and development of the exam. So, we thought we’d share a little more on the “who, what, and how” behind the ARE and leave any mysteries behind.
The ARE is developed and maintained by NCARB, but also supported by the efforts and collaboration of many other contributors to this professional licensure exam. Let’s get to know them.
Each year, over 100 architects from around the country give back to the architecture profession by volunteering for NCARB’s examination-related committees. Some of these volunteers are recently licensed architects, others have extensive professional experience, and the rest fall somewhere in between. They all offer their time, knowledge, and expertise to ensure the exam accurately reflects architectural practice. As committee members, they meet various times throughout the year to write, develop, and review case studies and test questions—also known as items. They also receive extensive training in the components of test development, including cognitive levels, item types, and congruence.
“Where do these questions come from?” Interestingly enough, our volunteer architects draw from their own experiences, as well as established industry-standard publications. In fact, all of the case studies on the ARE are based on real-world projects that our architects have worked on—providing our test-takers with actual scenarios and resources for the exam.
Psychometricians, or those who master the science of measuring and testing the validity of exams, are essential to the development of the ARE. They are the ones who provide us with guidance throughout all stages of the development process, including writing and evaluating items, assembling test forms, and monitoring the health of the exam. It’s critical for the exam to be legally defensible, which means it accurately and fairly assesses each candidate’s knowledge, skills, and abilities. With the assistance of psychometricians, we are constantly ensuring the exam follows best practices within the testing industry.
While our volunteers are creating exam content, NCARB’s Examination team also plays a vital role in the ARE experience. As a small, but mighty team, the Examination Department manages all aspects of exam development and operations. We typically serve as liaisons to committees, train volunteers, and facilitate several meetings. We also make it a priority to partner with other NCARB departments to address test-related inquiries from both candidates and state licensing boards, as well as collaborate with psychometricians and other testing partners as we aim to make continuous improvements to the exam.
Believe it or not, you also contribute to the development of the exam! To help determine the validity of newly written items, we typically include 15-20 “pre-test” items (that do not count toward your score) in each division. Once we collect data on these items, we can determine if they should become scored items or not. If an item performs poorly, we’ll work with our volunteers and psychometricians to assess whether the item needs to be improved and pre-tested again, or if it simply needs to be deleted. Items that perform well continue to be used on the exam, with a new “scored” status.
Have more ARE-related questions?
In the coming months, we’ll be posting additional articles that will dive into how exam content is developed and scored, as well as why the exam changes. Stay tuned!
Until then, we encourage you to visit the ARE 5.0 Online Community, where you can post questions and get feedback from our experts and fellow licensure candidates.