From : Communities>>Regulatory Open Forum
Hello Jose, To my knowledge, the change of O/O does not trigger a notification that needs to be confirmed, nor does it trigger a review of enforcement history.  The change of ownership and O/O is merely an administrative update that gives FDA both current information and a history of changes.  Of course, if there are known red flags with any of the involved organizations, changes can be scrutinized. Regards, James ------------------------------ James Bonds J.D. Director Regulatory Affairs Atlanta [More]

From : Communities>>Regulatory Open Forum
Dear Roy, You do not mention any important functions of the syringe/applicator, other than the Primary Packaging function for which you have identified testing to assess impact. The determination of these functions (e.g. deliverable dose or dose accuracy) could provide important testing to verify that no impact on performance. Also, an assessment on the impact of the change on the usability could be required (particularly if the ergonomics/forces change) or patient risk would be prudent, which [More]

From : Communities>>Regulatory Open Forum
Wondering if anyone has seen FDA guidance for timelines or procedures for all these Emergency Use Authorizations to transition to cleared IVD or Devices? Beverly Whitaker Indigo Consulting Group, LLC --------------------------------- Beverly Whitaker Beaufort SC United States ---------------------------------

From : Communities>>Regulatory Open Forum
Great! Thanks Anna --------------------------------- Anna Alonzi MD Sr. Regulatory Associate Newtown PA United States ---------------------------------

From : Communities>>Regulatory Open Forum
Hi everyone, I just finished it, and it is a really simple task! Go ahead! Thanks Anna --------------------------------- Anna Alonzi MD Sr. Regulatory Associate Newtown PA United States ---------------------------------

From : Communities>>Regulatory Open Forum
Thank you Dinar! ------------------------------ MARIA GUDIEL Brea CA United States ------------------------------

From : Communities>>Regulatory Open Forum
Thank you Richard! ------------------------------ MARIA GUDIEL Brea CA United States ------------------------------

From : Communities>>Regulatory Open Forum
The short answer is "yes" provided that the development cell bank was the source for the GMP bank and is comparable in terms of performance. However, the devil is in details and you need to evaluate "comparability" carefully between the development bank and the GMP bank with respect to the characterization data you plan to use for, e.g., to support GMP bank for production, etc. Two ICH guidance documents are useful to look at, Q7 Table 1 and Q5D. The US FDA generally follows ICH guidance but EMA [More]

From : Communities>>Regulatory Open Forum
Yes, exactly i asked same

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous Why not use Adobe to fill out the form?  You will need it to compile the submission anyway.

From : Communities>>Regulatory Open Forum
Hi Annie, I knew before that I wouldn't be able to attend to the webcast, so I did not register for it. But I am very curious on Dr. Akras insights. Is it possible to view a recording of it? Thanks, Britta ------------------------------ Britta Cyron Bochum Germany ------------------------------

From : Communities>>Regulatory Open Forum
Dear Lee & Spyros, Many thanks for your invaluable advice - really appreciate your time in considering and providing deep insight. Kind regards, Roy Jamieson (BPharm Hons) Regulatory CMC Consultant

From : Communities>>Regulatory Open Forum
Hi Beverly, To find out details on EUAs go to the FDA website central for EUAs at  https://www.fda.gov/medical-devices/emergency-situations-medical-devices/emergency-use-authorizations#coronavirus2019.    They are pumping out lots of them pretty quickly.  Each type of EUA has different requirements and FDA is flexible depending on the EUA you are looking for.  Timelines are not specific I just asked that question of one of my connections at the FDA today.  They are giving priority to more technically [More]

From : Communities>>Regulatory Open Forum
I have not seen anything, but during the interactive EUA process FDA were very clear that we need to continue with 510[k] preparation and offered supportive and constructive comments of where additional information would be needed. Although the EUA team are very busy, they see it as mutually beneficial, well actually in everybody's interests, to help us to a cleared status as soon as possible and the level of interactive engagement has been great. I am not convinced any general guidance would have [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous Dear RAPS members, I am preparing a submission for a device that has no special controls and we have identified the following standards to name a few. 62304-  ANSI AAMI IEC   62304:2006/A1:2016 62366-1:2015-  Medical Devices - Part 1: Application Of Usability Engineering To Medical Devices 14971- Medical Devices - Applications Of Risk Management To Medical Devices I am trying to see what approach will be good. Should I prepare a DOC or [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous Have you looked into PRA Health Sciences?

From : Communities>>Regulatory Open Forum
Hi All, Always appreciate and respect the great advice that comes through this forum: The scope of my question is CE Mark of a Class IIa medical device system under the MDD (and then eventually MDR): We have Class I devices which will be CE Marked through self-certification. These devices can be used with other CE marked products (not owned by us). One of which is not CE Marked as a medical device (conformity to machinery and low voltage directives). In terms of what we consider this vendor, what [More]

From : Communities>>Regulatory Open Forum
Thank you all for participating in our Tagging Project! We're glad to hear you enjoyed it. All volunteers were entered into a drawing for a $50 Amazon gift card. See a video of the drawing attached.  I'm happy to announce that the winner is ...  @Jonathan Amaya-Hodges ! Thanks again to all who participated. If you're interested in more volunteer opportunities, see our full list here .​​ ------------------------------ Danielle Fezell Manager, Chapter & Volunteer Relations, RAPS Rockville MD United [More]

Files Attached Document
RE: Sort It Out by participating in the RAPS Tagging Project

From : Communities>>Regulatory Open Forum
Thank you RAPS, what a pleasant surprise! I appreciate the opportunity to contribute to the project! Now, if only Amazon had any toilet paper in stock... ------------------------------ Jonathan Amaya-Hodges Associate Director, Regulatory Affairs CMC Combination Products and Medical Devices Cambridge MA United States ------------------------------

From : Communities>>Regulatory Open Forum
I disagree with Richard. I just had a conversation with the COVID-19 hotline (11:45 am, May 7) and asked about this issue after having read an update from the FDA that said UDIs for EUA devices are waived and GMPs are under limited enforcement. The person I spoke with said the update is correct and that UDIs are waived for EUA devices.  Feel free to contact me if you have any questions.  Bob Bard ------------------------------ Robert Bard JD, RAC [Managing Director] South Lyon MI United States - [More]

From : Communities>>Regulatory Open Forum
Hi everyone, As currently drafted,  the 2020 Chinese Pharmacopeia, the benchmark publication on the safety and efficacy of pharmaceuticals legally available in China, includes 319 new entries. The publication includes more than 5,500 traditional Chinese and Western medicines. The official compendium of the standards of purity, description, test, dosage, precaution, storage, and the strength for each drug legally marketed in China is published by the Chinese Pharmacopoeia Commission. It is designed [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous I'd recommend a statement that you are using these standards as general use. A Declaration of Conformity allows you to submit less testing information, but FDA still may request it. In the case of the standards you mentioned, FDA will require that information (e.g. software documentation, risk management, etc). So I would not bother with the DoC as you still have to submit all that material. Here was a nice thread discussing the topic [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous When this was first issued we printed it out, filled in the answers with careful handwriting and then scanned it back in - which seemed to be perfectly acceptable. Since then we've converted their form to a fillable PDF.​

From : Communities>>Regulatory Open Forum
Hello,  I can see many unapproved combinations of Minoxidil as topical solution like minoxidil+ Azelaic Acid; Minoxidil + Finasteride; Minoxdil+ niacin+retinol+caffeine that are available online for sale in US but these drug products are not approved by FDA as visble from USFDA website.  Can anyone explain that is there any mechanism or guideline to allows to sell such unapproved drug products online in US and also in EU? Or is this totally illegal practice?  Thanks Ankur RAC

From : Communities>>Regulatory Open Forum
Bob, I stand corrected; if you confirmed with FDA that is good.  From what I was reading and seeing (I must have missed that update) there was nothing addressing UDI or no UDI.for EUA products.  (Personally I am a bit surprised at this since the whole concept of UDI is traceability and they waive this for emergency use products - when there is an issue this is where UDI becomes so important.  Shrugs.) ------------------------------ Richard Vincins RAC Vice President Global Regulatory Affairs --- [More]

From : Communities>>Regulatory Open Forum
Hi, Ankur - Some may be "legal," others not. It's a big industry, and it is fair to be cynical. Combination products for sale that have not been approved-as the combination-by FDA are just that, unapproved drugs. I assume you checked for the approval status in FDA's "Orange Book" (https://www.accessdata.fda.gov/scripts/cder/ob/index.cfm). Even if both active pharmaceutical ingredients in a 2-drug mixture were approved separately on their own, it does not mean the combined product is approved for [More]

From : Communities>>Regulatory Open Forum
Hello Richard, Yesterday, I received a follow up from the Hotline (CDRH-EUA-Templates ) to my query. I was reminded that the waiver to good manufacturing practice and labeling requirements were included in the individual authorization letter. The person responding to my question concerning the UDI requirement provided the following: UDI is not specifically noted; however we are not enforcing UDI during the emergency. The specific authorization letter I was reviewing was for [More]

From : Communities>>Regulatory Open Forum
Hello Anonymous  You will be generating software documents (which is data of a sort), in accordance  with  ANSI-AAMI IEC 62304, and there is output from ISO 14971 which goes into the submission.   I just think DoCs are wasteful busy time and would do as few as possible. Regarding IEC 62366-1, maybe if you want mention it and do a DoC, but if the device  usability  study is not required in a submission don't  put it in there unless asked.  Just my opinion. Biocompatibility if used, is generating test [More]

From : Communities>>Regulatory Open Forum
Thank you!!! Good to know that everyone is having a wonderful interactive experience. --------------------------------- Beverly Whitaker Beaufort SC United States ---------------------------------

From : Communities>>Regulatory Open Forum
These are all unapproved new drugs. Many people who have very limited knowledge of our OTC drug system, assume that if it is sold OTC, it is a monographed drug and they can change the formulation. They do not know that there are two types of OTC drugs allowed-compliance with a monograph or NDA. Minoxidil is one and chlorhexidine antiseptic wash is another. ------------------------------ David Steinberg,FRAPS President Steinberg & Associates, Inc. Pompton Plains NJ USA 609-902-8860 -------------- [More]

From : Communities>>Regulatory Open Forum
The only  possible way I can see any of these products being legally marketed in the US without going the OTC NDA route would be if the ingredients  other than Minoxidil are considered "inactive" and have some purpose (other than their active ingredient purposes) in the formulation.  That said, this might work for the last combination in your listing because all of these can and are often used in OTC products as inactive ingredients with understood and current reasons for existing in a formulation [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous For device-lead drug combination products, is there any difference in the quality (grade) of API used compared to a pure drug product? The cGMP guidance for combination products does not seem to specify, and since drug claims cannot be made on device-lead drug combination products, it was not clear what quality of drug is required. Thank you!

From : Communities>>Regulatory Open Forum
Hi @Britta Cyron , Thanks for your question. Let me connect with m​y RAPS colleagues on this to get you an answer and then I will follow-up with you directly. Best, Annie ------------------------------ Annie O'Brien Community Manager Regulatory Affairs Professional Society regex@raps.org ------------------------------

From : Communities>>Regulatory Open Forum
Hello, If there is a significant change to an accessory cleared under a 510(k) of a product, are we supposed to file a significant change to the FDA for the original 510(k) for the accessory? ------------------------------ Shikha Malik Regulatory Affairs Specialist II Dallas TX United States ------------------------------

From : Communities>>Regulatory Open Forum
​I doubt FDA would have any willingness to change the requirements or expectations for a drug product based on whether it is in a strictly drug product versus in a combination product.  The fact also that there is not a published allowance for this is further evidence that FDA expects that the drug will meet the requirements as expected for drug products without providing any allowed changes or classes of changes.  Remember, FDA expects that drug products meet specific requirements.  Things like [More]

From : Communities>>Regulatory Open Forum
Annie: Thank you for sharing this news.  I am curious whether the Board considers this a limited exception or a potential new normal option going forward? Scott ------------------------------ Scott Bishop Houston TX United States ------------------------------ ------------------------------------------- Original Message: Sent: 04-May-2020 08:50 From: Annie O'Brien Subject: New: Take the RAC Exams Online this Summer! The RAC board has been working hard to find solutions offering more flexibility [More]

From : Communities>>Regulatory Open Forum
Hello Shikha, This depends on whether the form, function, and operation of the medical device is affected by the change to the accessory.  Without knowing the device, the accessory, or the type of change, it is hard to say, but I refer you to the FDA Guidance document for when to complete a 510(k) for an existing device.  If you go through the flowchart and read the descriptors for each there is the item B.5 and then the sub-boxes 1 through 4.  There is the question whether a change to accessory [More]

From : Communities>>Regulatory Open Forum
Hello, I agree with Ginger, when you look at standards there will most likely be an output of documents from following those standards, i.e. risk management file, usability report, all the software documentation.  These would be included in the different sections of the 510(k) so you can claim them as recognised standards you are following.  I have mentioned in previous posts, we take a simple approach for the declaration of conformity to standards that is a small table describing what we are complying, [More]

From : Communities>>Regulatory Open Forum
Thank you for posting this here Annie as the webcast was excellent (as would be expected from Dr. Akra haha) - but really it was great to have this publicly available as there was nice information about the EU MDR conveyed. ------------------------------ Richard Vincins RAC Vice President Global Regulatory Affairs ------------------------------

From : Communities>>Regulatory Open Forum
These types of products and combinations you mention are all unapproved drugs and unapproved combinations.  Unless the specific combination is approved or listed in an OTC monograph, it is a new drug and requires a NDA to market it.  Minoxidil is a Rx to OTC switch product so it requires a NDA or ANDA to market this drug in the US, even as a OTC drug.  Thus any combination with minoxidil is a new drug. In the past the FDA has also specifically stated that combining different types of products (drug [More]

Is data integrity music to your ears?  Ours, too!

ALCOA, GAMP, Part 11, GIGO, we cover it all.
(Sung to the tune of Simon and Garfunkel's "The Sound of Silence.")

Anx·i·ety (noun)
The state of uneasiness caused by apprehension of possible misfortune.

Yep.  That’s the word that comes to mind whenever anyone mentions FDA inspections.

But anxiety often stems from a lack of control, and in a regulatory inspection, you have more control than you might think.  There are many steps you can take -- before, during, and even after an inspection is over -- that can give you a fair degree of control over the outcome.   Here, Polaris auditors Lauren Kelley and Michele Commins share some of those steps with you.



Pre-inspection Preparation
For-cause inspections may be unannounced, but routine FDA inspections of submission data are scheduled in advance*.  That means most inspections are not pop quizzes; they’re final exams.
Remember how happy you were when a teacher gave you access to a prior year’s exam to study from?  You knew the type of questions that would be asked.  You knew how to prepare.

So this is the first tip we’d like to share.  FDA has, indeed, given you a copy of their exam in advance, in the form of its Compliance Program Guidance Manual, CPGM 7348.811.  This is the document all FDA field investigators use to conduct inspections at clinical sites.  It outlines in great detail what documents investigators will review, what dates they’re going to verify, what processes they’ll evaluate, what data they’ll collect, and what records they’re going to compare.  Despite its rather uninspired title, this is your copy of the final exam.

You know cramming is a risky strategy, so the earlier you get familiar with the CPGM the better.  Inspection readiness is a state of preparedness more than it is a laundry list of activities; it takes some time to get there.

When the Inspector’s in the House
According to the CPGM, one of the first pieces of information the FDA investigator will obtain is a list of all of the studies performed by the clinical investigator, including protocol number, sponsor, and study dates.  So even though FDA has scheduled its inspection with you, and has told you what study the investigator is coming to inspect, any study is fair game.  An FDA investigator can look at any document she wants, or talk to any staff member he chooses, whether related to the “assigned” study or not.

Most of your preparation will have been study-specific; questions about other studies will catch your staff off-guard, and a review of records for other studies may find them less than inspection-ready.  So here’s our second tip.   Avoid anything that might pique the investigator’s curiosity about a study that is not the original subject of the inspection.  Make sure the room you reserve as your investigator’s “home base” is free of any documents, reports, notes, phone lists, and post-its.  Make sure you tidy up offices, workspaces, and facilities site-wide, and keep extraneous chatter in check.

After the Visit
If your FDA inspection resulted in zero observations, then stop reading, thank your awesome staff members, and go celebrate.  If, however, you did receive a Form FDA 483, it’s probably not the end of the world, but you do have some work to do.  Our third tip is this:  remember that the sponsor/CRO is your ally here.  They have as much invested in FDA’s assessment of your study data as you do, and they have the regulatory, QA, even legal resources that you might not.   You’re not required to formally respond to 483s, but if you do, you’re likely to receive a more favorable Establishment Inspection Report (EIR) in the end.  Let your sponsor/CRO help you with your response.

Tips Do Not a Plan Make
Tips are helpful, but you’ll need more than that to ensure a successful FDA site inspection.  You need an inspection readiness plan -- a plan that you document and keep current.  All site staff members need to train on the inspection procedures and the individual roles they will play.  (Fourth tip: don’t forget to train your temporary employees; an office temp working at the receptionist desk could be the first person your FDA investigator speaks with.)

A Last Thought
Inspections are stress-inducing events, and nervous people make mistakes.  Investigators know this, and expertly exercise the “pregnant pause,” knowing how difficult it is for people to withstand an excruciating silence without volunteering unsolicited information.

So one last tip:  conduct a mock inspection before the FDA comes to visit.  It will stress test your procedures and identify improvements you need to implement.  A thorough mock inspection will give staff members an opportunity to rehearse their roles and interview techniques so they can execute your plan and speak to the FDA investigator with confidence.

_______________________________
* For-cause inspections are also known as Investigator-oriented, and routine inspections are also known as study-oriented.

 A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites

What can small sponsors do to secure the outsourcing resources they need as large CROs form strategic alliances with Big Pharma?

Partenships between large pharmaceutical companies and large CROs have become the norm.  The advantages for sponsor companies include shared risk, knowledge transfer, dedicated resources, shorter time to market, and the ability to implement the massive data integration that clinical development requires.  Strategic alliances are arguably as advantageous for their outsourcing partners, providing a steady pipeline of work that’s larger in scope and longer in duration than is typical under traditional arrangements.



Strategic Partnerships in Big Pharma: Implications for the Rest
Advantages for one segment of the industry can introduce disadvantages for another.  Alliances among the large players increase competition for top-drawer CRO resources. Smaller sponsors may find it more difficult to receive the quality of service and level of commitment they might otherwise expect.  A large CRO is likely to assign their most talented personnel to projects associated with their strategic partners.  And if a partner study were to run into trouble, it would be hard to fault a CRO for pulling experienced staff members off a smaller project in order to help out with the big client.  Though a reputable CRO wouldn’t jeopardize the relationship with the smaller client, their responsiveness to routine requests might suffer.  It might take longer to get a question answered, receive requested documentation, making the job of vendor oversight difficult.

Though selecting a large, well-established CRO at the outset may have seemed like the safe bet, what do you do if you’re a small sponsor or biotech start-up who is dissatisfied with the level of service you’re receiving?

“Let’s Bring It In-house.”
Put off by a negative experience, many companies decide to curtail outsourcing, and bring functions like monitoring and project management in-house.

This response is understandable, but it rarely goes well.  There’s good reason to outsource study functions to a CRO, especially if you’re small, or new, or both.  Mid-study is a terrible time to realize you’re in over your head.  You may find it difficult to contract with the service providers you want in the timeframe you need them.  Services you would have preferred be performed by a single company may now have to be farmed out piecemeal, which has the overhead of multiple contracts and makes vendor oversight more difficult to manage.  You don’t have time to go through a thorough qualification process.  You’re not in a good bargaining position; you’re trying to buy a new car after they’ve towed away your old one.  And now you have to rely on your new service provider(s) – the ones who may not be your first choice, whom you had to choose in haste, whom you didn’t get to thoroughly vet – to jump in midstream and pick up a study that is already in trouble.

Options for Small Sponsors and Start-ups
So what’s the answer?  You have several good options we’ve seen work well for smaller organizations.

(1) Go smaller.  Look beyond traditional outsourcing choices and consider selecting smaller vendors who may well be in a better position to focus on individual projects and give priority to shorter term engagements.  After all, a project that’s small to a big CRO will be comparatively big to a small CRO.

(2) Go long-term.  Consider establishing strategic partnerships of your own.   Doing so would increase the expertise and technology to which you’d have ready access, and could extend your global reach.

(3) Go big, but go vigilantly.  There’s a reason companies hire big, reputable CROs.  ‘Big’ means the CRO has an impressive set of resources at its disposal.  ‘Reputable’ means it has a proven record of successfully completing studies, producing reliable data, and preserving subject safety.  Smaller sponsors can still take advantage of everything a big CRO offers if they can commit to conducting very strict vendor oversight.  They need to closely monitor the quality of the work the CRO performs, frequently assess adherence to the many written study plans, and make sure deadlines are being met.  Service contracts should guarantee a certain level of responsiveness (by specifying maximum turn-around times, for example), especially for those requests that enable these oversight activities.


Qualification is Key
While the key to Option 3 is effective vendor management, the key to Options 1 and 2 is effective vendor qualification.  Resources are tight in a small company, so you need to direct them where your exposure is greatest, where they’ll do the most good.  What could be more essential to the success of your study than choosing the right company to conduct it?   Many sponsors conduct on-site vendor audits.  That’s good.  That’s necessary.  But it’s not sufficient.  To consistently choose the best possible CRO for your study, sponsors need to:

• Formally document and maintain vendor selection criteria and qualification process
• Form selection committees that represent all sides of your business – finance, contracting, operations, finance, QA, data management, pharmacovigilance, biostatistics, etc.
• Conduct on-site audits with well-trained, well-prepared QA auditors
• Track the resulting CAPA activities
• Ensure outstanding issues are resolved before the contract is signed
• Periodically re-evaluate vendors to make sure they can continue to deliver the same level of quality they’ve delivered in the past

Strategic partnerships among large companies have reshaped the research environment for industry players of every size.  Small and mid-sized companies who take the time to review current outsourcing arrangements, assess alternative models, and thoroughly qualify new vendors and partners will fare the best.

Photo Credit: FreeImages.com/Svilen Milev

Year in and year out, protocol deviations are the most common FDA Site Inspection finding. Why does this keep happening?

If you’ve seen FDA’s Inspectional Observation Summaries, you know that in 2015 the most frequently cited violation in clinical research by far was “failure to conduct research in accordance with the investigational plan.”  Do you know this finding also topped the list the year before that?  And the year before that?  In fact, deviating from the protocol has been the most common observation every year for the last decade.

Why does this keep happening?



The Nature of Protocols
This will come as a surprise to no one: not all protocols are well written.  Important procedures can be hidden in the most obscure places.  Charts depicting Time and Events Schedules are famous for carrying dozens of footnotes that appear nowhere else in the protocol, yet convey important study procedures.   For instance, a pre-dosing column may include a footnote that provides a timeframe for performing a physical exam; a post-dosing footnote might specify the interval at which vitals must be taken.   Failing to follow study procedures compromises subject safety and data integrity; FDA won’t care whether the procedures were in big bold italics or 7-point font.

This, too, may come as no surprise, but not all protocols are error-free.   Information in charts may not match the narrative.  Procedures in Section A may conflict with procedures in Section B.  When the FDA investigator spots an inconsistency, you’ll be asked which of the two conflicting procedures you followed and why.  If you performed procedure A only because you didn’t even notice there was a B, it will be clear you didn’t read the protocol as thoroughly as you needed to.  The FDA investigator may become concerned that your study execution differed from the sponsor’s intention.  This is not a concern you want to trigger.

For these reasons, it’s imperative that study staff read and understand the protocol.  Study team members need to ask questions about anything they’re unsure of, seek clarification on protocol inconsistencies, and get responses that satisfy before starting the study.   A PowerPoint overview is not sufficient training.

One more irksome attribute of protocols that can make them difficult to follow -- they change.  While most study sites allocate time and resources for initial protocol training, many lack a plan for training staff on protocol amendments.   A disproportionate number of protocol deviations occur in amended procedures, and it’s often because staff members have been insufficiently trained on them.  (And when you do train on protocol amendments, don’t forget to document it.)

Deviation Temptation
A protocol is not a suggestion; PIs cannot substitute their own judgment for prescribed procedures, no matter how well-intentioned the departure.  The protocol for a psoriasis study might call for the PI to perform a series of punch biopsies, very invasive procedures.  After the first biopsy, an empathetic PI might be tempted to skip a second if he observes the plaque is clearing up; the drug is working.  But this would be a protocol deviation.  The protocol for another study might preclude the use of a particular drug, even though the drug is routinely used throughout the practice to treat a symptom that a study participant is exhibiting.  But the study protocol trumps standard of care; prescribing the drug would be a protocol deviation.

A PI who feels she must deviate from the protocol for some reason must obtain prior approval, since failure to follow the protocol can jeopardize the reliability of the study data, if not subject rights and safety.



Deviations Happen
So you’ve thoroughly read the protocol, you’ve asked your questions and received the necessary clarifications, you’ve trained your staff on the protocol and its amendments, and you do your best to follow them.

Despite all your preparation and vigilance, protocol deviations happen.  They just do.  And when they do, here are two don'ts.

(1) Don’t panic.

(2) Don’t let an FDA investigator find them first.
Take the time to fully document any protocol deviations.  Be sure to record why they happened, how they were corrected, and what was submitted to the IRB.

[Note: IRBs have different requirements about what types of protocol deviations should be communicated.  Out-of-window visits are common and are frequently considered too minor to report.  But nothing’s black and white.  If the missed visit resulted in missed doses, that would probably change the calculus. The PI needs to determine whether to notify the IRB, and if no submission is thought necessary, it’s a good idea to document why not.]

_______________________________________________________________

A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites.

While patients are consumers of healthcare services, they can’t be considered customers in the traditional sense. The same is true of students. Over many years of teaching, I’ve noticed this parallel between the healthcare and education professions; both require significantly more “customer participation” to achieve desired outcomes than other industries do. That’s one reason it’s difficult to measure the quality of these institutions and the skills of their practitioners. That’s also why both industries focus so intently on engaging our communities; we simply can’t be successful unless we do.

“Can You Hear Me Now?”
As the old joke goes, there are 3 types of people in this world: those who are good at math and those who aren’t. Many students believe themselves to be permanent denizens of the 2nd camp. They find mathematical concepts confusing and the terminology inscrutable, so they tend not to ask questions. They’re afraid they’re being judged, so they’re not always truthful. Tests and exams fill them with anxiety, and sometimes even panic (no doubt waking to nightmares of trains leaving stations at varying rates of speed). These are the students who need my help the most. Our success in overcoming these challenges together will depend heavily on the student/teacher connection we can establish, yet few students are actually able to choose the teacher with whom they are asked to connect. Sound like healthcare yet?



So it’s no surprise that trends toward greater patient engagement in healthcare, and patient-centricity in clinical research, emphasize clear and compassionate communication. Doctors, like instructors, need to explain concepts in relatable terms, encourage and address questions, assuage unwarranted anxiety, and establish trust. Until that happens, a meaningful partnership isn’t even possible.

When the Cat’s Away, Will the Mice Make Good Choices?
You may remember that old college rule of thumb: 1 hour of class requires 3 hours of study. This means instructors have just 25% of their students’ time to inspire the behaviors and habits that will make a success of the other 75%. “Don’t be the Sage on the Stage,” the mantra goes, “be the Guide on the Side.” If you’ve ever taught in an academic setting, you know how challenging that can be. The role of lecturer is fairly obvious, but the role of coach is nuanced; it evolves over time and it’s different for everyone.

And if a college instructor has just 3 hours of face time a week, a physician is lucky to have 3 hours of face time a year. That’s not much time to persuade, convince, and encourage the lifestyle choices and medication adherence essential to maintaining good health. And when you consider that a good part of each office visit is spent performing examinations and assessments, it’s easy to understand the excitement surrounding mobile health technologies. Beyond delivering real-time, real-world data, smartphone apps can send patients important reminders, make complying with diet and exercise recommendations easier, and make progress toward fitness goals visible.

“And the Survey Says…?”
Most service industries are rightly concerned with customer satisfaction – how to achieve it, how to measure it, and how to improve it. So last year, an article entitled “The Problem with Satisfied Patients” caught my eye. The Atlantic article concluded that higher hospital satisfaction ratings don’t necessarily correlate with better healthcare. A five-star student course evaluation can be similarly misleading. Pleasing a student is not the same thing as teaching a student, just as making people happy doesn’t make them well. That’s not to say that hospitals and colleges shouldn’t solicit feedback; of course they need to understand the perspective of the communities they serve. But healthcare facilities and schools should give satisfaction surveys their proper weight or they risk implementing changes that consume resources but do nothing to improve a patient’s health or increase a student’s proficiency.

Outcomes-based Evaluation
So if outcomes are paramount in both medicine and academia, it follows that the quality of care and education would be best measured by evaluating those outcomes. Right?  Well, it’s a good place to start, but since patients and students share responsibility for success with their doctors and teachers, an individual outcome may be misleading. An instructor can influence, but can’t control, whether a student works on practice problems, studies for tests, asks questions, or even pays attention. A doctor can’t control whether a patient takes a prescription, follows medical advice, or reports relevant symptoms. There isn’t always a straight line between quality of service and success rate.


College instructors try to keep their students engaged by tailoring their coaching styles, offering a mix of delivery methods, seeking out fresh ideas to make the concepts relevant, and maintaining convenient office hours. Looking to improve patient engagement, healthcare systems have found that many people face situations that prevent them from keeping appointments and following medical advice. Some organizations are now providing copay assistance, arranging transportation, and employing patient care coordinators to place routine monitoring calls. None of these services are free, but they can be considerably less expensive than eating the costs associated with hospital readmissions.

The Partnership Starts Here
Teachers want their students to learn and healthcare providers want their patients to be well, but students and patients must actively participate in order to meet those goals. Handing out easy A’s and offering gourmet hospital menu items in response to survey responses won’t cut it.

Success begins with clear, compassionate communication – communication designed to explain complex concepts, to build trust, and to encourage the behaviors that lead to positive results. Understanding the challenges students and patients face enables educators and medical professionals to offer practical, meaningful solutions that can actually improve outcomes.

[In case you missed it, our last blog post was about the most common site inspection finding every year for the last decade: Protocol Deviations and How to Avoid Them.]

As a sponsor or CRO, you understand the importance of a thorough site selection process. A site needs to be able to meet enrollment targets and time frames, protect the rights and safety of study participants, execute the protocol, deliver quality data, and maintain GCP compliance. That’s what your site feasibility surveys and pre-study visits are designed to evaluate. And as you’re assessing a site’s abilities, the site is conducting its own feasibility process. They’re mining their patient database and assessing inclusion/exclusion criteria. They’re reviewing staff credentials and ensuring they have adequate resources to manage the number of subject visits and collect the data the protocol requires.

But when we conduct GCP audits, we find there’s one perspective that is sometimes overlooked by both sides: the needs of the study drug itself.




Study Drug Attributes Affecting Site Selection Process

IP Environment.  Aside from needing sufficient storage space, many drugs have special storage requirements. Does the site have the equipment and resources needed to maintain and adequately monitor and record environmental conditions such as temperature or humidity? Do they have agreements with their vendors that guarantee a specific response time for repairing or replacing faulty equipment? If they lose electricity, do they have back up power, or at least provisions to move the IP off-site? (This is a common auditor question in hurricane-prone areas.)


Preparation of Study Drug.  Does your investigational product need to be reconstituted in a liquid? Do doses need to be compounded in different concentrations? Does the protocol require that an IV solution be prepared, filtered, and sterilized? These activities take time, specially trained personnel, and sometimes specialized equipment such as ventilation hoods. If your protocol demands an involved IP prep, your feasibility survey must include questions that allow you to assess these site capabilities and your pre-study visit should definitely include some time in the pharmacy. 

Drug Administration. Handing over a bottle of capsules to a study participant is one thing; inserting a butterfly catheter into an antecubital vein is something else again. If drug administration is very invasive, you’ll want to verify that the site has taken this into account when providing you enrollment projections. During subject visits, staff members may have to calculate doses, give intramuscular injections, perform infusions, or conduct sterilization procedures. You’ll want to verify that site staff has this expertise if required. Some clinical trials require a blinded dispenser who cannot be involved in any other study procedure or activities. If so, does the site have the resources for this?

Site Selection: it’s not just the PI, it’s the IP too
The study success and patient safety are jeopardized when a site can’t meet its enrollment target or doesn’t have the resources to execute the protocol. IP requirements can affect a site’s ability to do both. It’s critical that your site selection process – both your feasibility questionnaire and your pre-study visit – evaluate how well the site can meet the storage, preparation, and administration requirements of the study drug.

__________________________________________________________________________
A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites.

Photo Credit: By Harmid (Own work) [Public domain], via Wikimedia Commons

Developing safe and effective drugs requires a coordinated effort across a diverse set of disciplines. This is easier to observe at some points in the process than at others. Once a product is well into human trials, it can be easy to forget that developments on the manufacturing side of the house can affect the clinicians who are conducting the studies.




Trialed Drug vs Marketed Drug


Once researchers are satisfied that animal studies show that an Active Pharmaceutical Ingredient (API) is effective and nontoxic at initial doses, there’s an urgency to get it into the clinic and begin human studies as soon as possible. Though the ultimate product may be marketed in one form, a different form may take less time to manufacture, and so would be the form given to human volunteers in earlier clinical trials.

A tablet, for example, is much harder to manufacture than a 2-piece hard shell capsule because determining the appropriate compression for a tablet takes time. (Tablets that aren’t sufficiently compressed will break apart in the bottle; tablets compressed too tightly may not dissolve as they should, earning themselves the entertainingly accurate moniker “bedpan bullets.”) Rather than wait until a tablet form of the drug can be fully developed, to save time, sponsors would likely begin human studies using a hard shell capsule version.*

To ensure that clinical trial data for the Investigational Product (IP) are applicable to the ultimately marketed product, clinicians run bioequivalence for dosage form studies. These small pharmacokinetics studies may result in changes, such as dosage amount or frequency, if people do not metabolize the studied formulation and the final formulation the same way.


Stability Test Failures

When we hear of a pharmaceutical company having to “pull its product,” we typically think of a recall scenario that involves consumers, distributers, and retailers.  Recall procedures fall under the GMP umbrella, and are spelled out in great detail in 21 CFR Part 211. However, similar procedures may very well be required of clinical site staff, long before the product ever sees its first drugstore.


Before any clinical trials begin on a drug, manufacturers would have been conducting stability tests for months. But stability testing may continue for years after the start of human trials, and analysts could detect a variety of troubling conditions in the course of their work. Product can change color or break apart. Capsules can crack and leak. Microbes could begin to grow, especially in moister product. The container closure system itself could be problematic; it could leech contaminating material into the product, introducing impurities, or it could extract material from the product, diminishing its potency. Any of these finding could mean that study drug would need to be pulled from clinical sites.

No one expects site staff to have detailed quarantining and recall procedures; the Sponsor will tell site staff exactly what they need to do. But what would this look like?

(1) Adulterated product that cannot be dispensed will need to be moved to a separate, secure area so it won’t be confused with good product. It might need to be stored there for a period of time or shipped back to the Sponsor.

(2) For certain, a site’s drug accountability procedures will be center stage. The only way a site can successfully recall bad product is if it has -- all along -- closely tracked the amount of IP it has received, dispensed, and still has on hand.

(3) Study participants who have any quantity of the bad product will need to be contacted, told not to use it, and told how to return it. (Note that this pertains to participants on the placebo arm as well, otherwise the blind will be broken.) Phone calls may not be sufficient; sites may need to invoke lost-to-follow-up procedures, such as sending registered letters. Remote, virtual trials, which often ship IP to participants, need to be designed to allow for the tracking and retrieval of bad product.

(4) What should be done if it turns out some participants have already used the bad product? Unfortunately, that’s one SOP you can’t write in advance; it would completely depend on the nature of the IP and the problem it has, the vulnerability of the patient population, the protocol, the participant’s proximity to the site, etc. Perhaps a careful case review to look for AEs associated with affected participants would suffice. More critical situations may require participants to undergo physical examinations or special testing. In many cases, study data associated with the use of the tainted IP would need to be identified and removed from the efficacy analysis.

(5) These quarantining and recall activities must be carefully recorded. IRBs and regulators will want written proof that all suspect IP has been accounted for. Sponsors might consider sending a CRA to ensure adequate documentation.


Re-labeling

Stability tests don’t have to fail to trigger action for clinical staff. Should a chemist discover a condition that requires a labeling modification -- a new expiry date**, for example – all the labels on existing product held at clinical study sites would need to be replaced. In these situations, the Sponsor may dispatch CRAs to replace the labels themselves, or negotiate with individual site staffs to do it instead. 


No GxP is an Island…

GMP professionals manufacture, package, and label biopharmaceutical products. GCP professionals conduct clinical trials on those same products. These roles are very different from each other, yet they don’t work in isolation. Formulation changes, stability testing, and re-labeling requirements represent three examples in which activities performed by GMP folks impact their GCP counterparts. Have you experienced any additional examples? Feel free to share them in the Comments section.

In case you missed it, our last post was about how attributes of the Study Drug influence the Site Selection and Feasibility process.

___________________________________________________________

* “By the time clinical trials start, they know what ingredients go in the cookie, they just don’t know how the cookie is going to turn out yet.”
       - Rosanne Sylvia-Heeter, Polaris Director of GMP Compliance and phenomenal cook

** Expiry dates are not required but are sometimes included on IP labels.

You know you need a computer systems audit, but that’s literally the extent of what you know.
Has this ever been you?

Yes, you use computers on a daily basis, and you may even use the system that needs to be audited. But you don’t spend your day thinking about where all the system components are located, how services and software are combined, and what Part 11 requirements apply. Terms like “cloud computing” make you feel slightly queasy. You’d rather get a root canal than discuss “distributed processing.” Your expertise is in manufacturing. Or clinical research. Or non-clinical lab operations. And somehow it’s your job to make sure an effective and properly-sized system audit is conducted. Great.



Yet your Quality Assurance colleagues -- whether they’re from your internal QA department or an external compliance company -- need your input. They need to understand what software is being purchased, what services are being contracted, how and where components of the system are being implemented, and how the system will be used.

The good news is that the QA auditors can help you. They know that FDA favors a risk-based approach to validation and Part 11 implementation, and they even know what that means. They love to talk about configuration management and change procedures. They love gathering evidence that demonstrates your system works correctly and is in a state of control, and they know what rocks they should look under to find and fix vulnerabilities.

What follows are examples of the types of information you need to convey to QA – and that they should be asking you about – to properly size and scope an audit.

How do You Plan to Use the System?

Suppose you need to audit the supplier of a new Document Management System. The first thing an auditor would need to understand is how you plan to use the system. How mission critical are the documents you’re looking to store?  Are they covered under regulatory scope?  Maybe you plan to use the system as a collaboration environment for developing new SOPs. That would require a relatively low level of scrutiny, especially if you only plan to print out the finalized documents for wet ink signature. (As a point of comparison, if you plan to use the system to finalize SOP approval, the auditor would need to check that Part 11 requirements for electronic signatures are properly implemented.) What if the Document Management System will be housing critical GxP documents, such as Trial Master Files, Master Schedule Sheets, or Master Batch Records? In these cases, the validation would have to be far more thorough, and Part 11 electronic record features, such as audit trails and archiving functionality, would have to be implemented and verified.

Here’s another “use” example. Similar to the term “Document Management System,” the term “Analytics System” does not tell the whole story. From a business perspective, study start up (SSU) metrics may be vital for sponsors and CROs to collect and analyze. But since they have no regulatory impact, the FDA would not require an SSU analytics system to be validated. (That doesn’t necessarily mean you might not want to, though.) On the other hand, a system that performs statistical analysis on study data for regulatory submission is about as critical as it gets, and would require thorough validation and Part 11 implementation. Other analytics systems, such as dashboards that pull data from critical systems, might fall somewhere between these two extremes.

What is the Vendor Providing? And How? And Where?

If you need to audit a complex system, the questions QA will ask you will go beyond system use. The auditors will need to understand the combination of software and services the vendor is providing, and where the software and data reside.

• Does the software and data reside internally at your company or does the vendor provide a hosting service?
  If the vendor is hosting, the auditor needs to tour the facilities and review SOPs and records to evaluate physical security, staff training, environmental controls, backup procedures, disaster recovery plans, data retention, computer infrastructure, and change control.
  
  
• Does the hosting vendor own its own servers or does it, in turn, outsource that function to a 3rd party hosting company, (possibly even in the cloud)?
  If the hosting is outsourced, ideally an auditor would be able to visit the hosting site. Failing that, the auditor would ask questions about the vendor’s qualification processes and review SOPs that govern vendor selection/management procedures. If the vendor outsources other services beyond hosting, those services might need to be considered, as well.
  
  
• Is the vendor providing any other services?
  Many EDC vendors will provide study-specific services such as screen development and data entry validation edits. Auditors would need to review SOPs for providing these services and understand how the vendor tests and manages modifications to these components as the study proceeds.
  Sometimes computer systems vendors provide ancillary services, such as help desk functions and user account management. That would mean additional SOPs and training records for the auditor to look through.

Other Considerations

There are many. For example, where are you in the product life cycle? You ask different questions about a new system than you would about one that has been operating for a few years. Is the product Commercial off-the-shelf (COTS) or highly customized? COTS systems vendors often have their own validation package which auditors would review, and then ensure proper operation in the sponsor/CRO’s specific environment. A highly customized or custom-built system would require a more extensive validation process.


The Take Away

CSV/Part 11 audits will never be standardized, cookie cutter type activities; there are simply too many factors -- in too many combinations -- to consider. You want your QA efforts to be worth the money you spend and be able to answer the questions FDA says you need to be asking. If you’re unsure how to do that, that’s ok. Other people know, as long as you can help them understand how you plan to use the system, what software and services are being supplied, and how components of the system are being implemented.

In case you missed it, our previous post was Notes 2 Fix Your Notes 2 File.
_______________________________________________
Many thinks to Lisa Olson for sharing her insights with me.

Protocol trumps practice. This principle seems clear enough, but complying with it is not always as straight-forward as it sounds. Years of practicing medicine has reinforced the way a physician responds to medical situations. But do these responses run counter to the investigational plan? Can a site’s commitment to standard of care affect its ability to meet enrollment targets?


There’s a lot to consider.



What’s Your Standard of Care?
When deciding whether or not to conduct a particular study, a PI needs to verify that the protocol is aligned with practice norms. For example, an early phase trial might exclude a medication that is part of a practice’s routine therapy. Is the study placebo-controlled? Does it feature a specific comparator drug? Will it include a washout period? Any of these elements could present enrollment challenges or preclude a site from accepting a study at all. Responsible sites want to make thoughtful decisions about study suitability; they want to provide realistic enrollment estimates. Sponsors want this too, and can help sites do both these things by providing them a sufficient level of detail about protocol procedures as early as possible.


The Road to Deviations is Often Paved with Good Intentions
Therapeutic misconception – a well-documented phenomenon in clinical research – occurs when a study participant “fails to appreciate the distinction between the imperatives of clinical research and of ordinary treatment.”* Study participants are not alone in this. Researchers blur the distinction themselves when they conduct procedures that are consistent with clinical care but deviate from the protocol. This may be particularly true for PIs who recruit participants from their own practices. An endocrinologist might ordinarily reduce dosage for a particularly diminutive patient. A pulmonologist would often skip a scheduled chest x-ray she felt wasn’t needed to avoid exposing her patient to unnecessary radiation. An orthopedic surgeon may decide his patient needs more recovery time than usual before attempting her first walk. In a clinical care setting, these decisions are sound, made in an individual patient’s best interest. In a clinical trial, if they differ from the investigational plan and haven’t been approved by the Sponsor, they’re protocol deviations.**

It May be Par for the Course, But It's Still an AE
Specialists who have experience treating particular conditions are also familiar with the complications that ordinarily accompany them. A nephrologist, for instance, knows that a patient with end-stage renal disease frequently experiences bloat from a buildup of fluid between dialysis sessions. Though useful for a doctor treating patients, this knowledge can actually work against a doctor running a trial. How? A PI may fail to report a stomach ache as an AE because it’s so typical, so expected. “Bloat is common for renal patients. If I recorded every GI incident, I’d be recording AEs all day.” At its surface, this PI’s argument sounds reasonable, but what if the study drug itself is contributing to the participant’s discomfort? In order to assess the drug’s gastrointestinal effect, the PI must document the frequency and severity of all GI events.

Lab values that are either above or below normal range are also prime candidates for AE underreporting. “Of course the participant’s liver enzyme is high – we’re testing a cholesterol drug.”

The Importance of Study Oversight
Any GCP course worth its registration fee will discuss the distinction between standard of care and the study protocol. In practice, the distinction is not always as obvious as training sessions might suggest. This is where well-trained CRAs come in. As site monitors, CRAs are in a position to catch deviations that result from lapses into standard of care. Reading through progress notes, a monitor can ensure that any untoward medical event has been reported as an Adverse Event. They can verify that procedures conducted by the PI and site staff are compliant with the protocol. Then, by reviewing which types of data must be collected and emphasizing the importance of following certain protocol procedures, monitors can take the opportunity to re-educate study personnel and help them avoid these common pitfalls.

_______________________________________________________________________
* Lidz CW, Appelbaum PS (2002) The therapeutic misconception: problems and solutions. Med Care 40: V55-V63.

**Andrew Snyder of the HealthEast Care System wrote a thoughtful piece describing the compatibilities that do exist between clinical care and clinical research. His arguments provide a useful counterpoint to the issues we’re raising here. https://firstclinical.com/journal/2017/1707_Research_vs_Care.pdf

A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites.

Sites frequently want to know how they can stand out to Sponsors and CROs to win more studies.
Our advice: Implement internal QC procedures.

Sponsors and CROs we work with consider a tight quality control program to be evidence that a site can be counted on to produce reliable data. It shows that managing quality at your site is a continual process, and doesn’t wait for monitors to arrive. In a risk-based monitoring environment, this is an increasingly compelling attribute.

Where to Start: The Usual Suspects
It makes sense for you to focus your QC efforts on those areas where you’ve historically had the most problems. If the phrase “trend analysis” makes you want to jump through a window -- it's okay -- you can climb back inside. You don't have to do a trend analysis. We've identified 3 areas in which audit findings are common and how you can avoid them.



Adverse Events (AEs) and Concomitant Medications (ConMeds). Often two sides of the same coin, AE and ConMed documentation needs to tell a consistent story. If source documents indicate a study participant had a sinus infection, it must be documented on an AE page, and any associated medications documented on the ConMeds page. A medication noted on the AE page must have a corresponding notation on the ConMed page. And all start and end dates must match across the source, AE, and ConMeds pages.

Drug Accountability Records. Calculating compliance percentages and counting pills are positively uninteresting tasks, easy to mess up, and involve math (which for some people triggers terrifying flashbacks of word problems about trains leaving stations). Is it any wonder that drug accountability records are frequent sources of error? Do some spot-checking: verify that the number of returned tablets matches the tallies recorded for them and recheck compliance calculations.

Essential Documents. Maintaining a complete, organized, uniform set of essential documents is an important, yet decidedly unsexy task. That’s why it’s a good indicator of your commitment to quality; a site that is disciplined enough to keep tight control over its essential documents is likely to carry that control into all aspects of trial execution. Make sure to file all documents associated with protocol amendments, such as IRB approvals and revised informed consent forms -- our auditors find these are the items most frequently missing from the essential document set. 

Write It All Down
Document your QC procedures in an SOP. It will serve as training material for site staff and a repository for worksheets and checklists.

There’s no magic organization for this QC SOP. A general set of instructions could outline how reviewers can verify that all documents follow ALCOA principles. For example, on (paper) source documents, are all pages and required signatures present? Are entries legible? Are corrections initialed, dated, and explained? Does the data make sense and lie within expected ranges? Have all data elements been populated? (Tip: turn the paper upside down to catch missing data.)

Checklists that are focused on particular types of documents should be as specific as possible. For example, QC reviews of source documents for screening visits would verify that the correct informed consent form was used, administration of consent was documented, medical release forms were sent if required, demographics were correct, all labs were received, reviewed and signed, all protocol assessments were completed, and all inclusion/exclusion criteria were met and documented.

A Virtuous Cycle
While designed to control quality, performing QC over time may actually improve quality. Results of QC reviews often suggest revisions you should make to your tools and operations to reduce error in the future.

Okay, you can climb back through the window again -- no one said CAPA. (But wouldn't that be impressive?)


Showcasing Site QC Processes
Does implementing a QC program require resources and time? Yes, and that’s the point. It’s evidence to Sponsors and CROs of your commitment to running a quality study. Not only that, but it demonstrates a proper respect for your study participants by ensuring their data can be used.

Oh, and make sure you highlight your QC program on feasibility questionnaires. It’s something to brag about.

________________________________________________________________________
A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites