From : Communities>>Regulatory Open Forum
The short answer is "yes" provided that the development cell bank was the source for the GMP bank and is comparable in terms of performance. However, the devil is in details and you need to evaluate "comparability" carefully between the development bank and the GMP bank with respect to the characterization data you plan to use for, e.g., to support GMP bank for production, etc. Two ICH guidance documents are useful to look at, Q7 Table 1 and Q5D. The US FDA generally follows ICH guidance but EMA [More]

From : Communities>>Regulatory Open Forum
Yes, exactly i asked same

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous Why not use Adobe to fill out the form?  You will need it to compile the submission anyway.

From : Communities>>Regulatory Open Forum
Hi Annie, I knew before that I wouldn't be able to attend to the webcast, so I did not register for it. But I am very curious on Dr. Akras insights. Is it possible to view a recording of it? Thanks, Britta ------------------------------ Britta Cyron Bochum Germany ------------------------------

From : Communities>>Regulatory Open Forum
Dear Lee & Spyros, Many thanks for your invaluable advice - really appreciate your time in considering and providing deep insight. Kind regards, Roy Jamieson (BPharm Hons) Regulatory CMC Consultant

From : Communities>>Regulatory Open Forum
Hi Beverly, To find out details on EUAs go to the FDA website central for EUAs at  https://www.fda.gov/medical-devices/emergency-situations-medical-devices/emergency-use-authorizations#coronavirus2019.    They are pumping out lots of them pretty quickly.  Each type of EUA has different requirements and FDA is flexible depending on the EUA you are looking for.  Timelines are not specific I just asked that question of one of my connections at the FDA today.  They are giving priority to more technically [More]

From : Communities>>Regulatory Open Forum
I have not seen anything, but during the interactive EUA process FDA were very clear that we need to continue with 510[k] preparation and offered supportive and constructive comments of where additional information would be needed. Although the EUA team are very busy, they see it as mutually beneficial, well actually in everybody's interests, to help us to a cleared status as soon as possible and the level of interactive engagement has been great. I am not convinced any general guidance would have [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous Hello, Does anyone know how long FDA's EUA process takes for approval compared to a 510k.  EUA seems to ask a lot of the same information that a 510k requests so not clear on what the benefits are or if it's worthwhile.  I assume you will eventually have to achieve traditional market clearance at some point. Any insight would be most appreciated. Thank you.

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous Dear RAPS members, I am preparing a submission for a device that has no special controls and we have identified the following standards to name a few. 62304-  ANSI AAMI IEC   62304:2006/A1:2016 62366-1:2015-  Medical Devices - Part 1: Application Of Usability Engineering To Medical Devices 14971- Medical Devices - Applications Of Risk Management To Medical Devices I am trying to see what approach will be good. Should I prepare a DOC or [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous Have you looked into PRA Health Sciences?

From : Communities>>Regulatory Open Forum
Thank you all for participating in our Tagging Project! We're glad to hear you enjoyed it. All volunteers were entered into a drawing for a $50 Amazon gift card. See a video of the drawing attached.  I'm happy to announce that the winner is ...  @Jonathan Amaya-Hodges ! Thanks again to all who participated. If you're interested in more volunteer opportunities, see our full list here .​​ ------------------------------ Danielle Fezell Manager, Chapter & Volunteer Relations, RAPS Rockville MD United [More]

Files Attached Document
RE: Sort It Out by participating in the RAPS Tagging Project

From : Communities>>Regulatory Open Forum
Thank you RAPS, what a pleasant surprise! I appreciate the opportunity to contribute to the project! Now, if only Amazon had any toilet paper in stock... ------------------------------ Jonathan Amaya-Hodges Associate Director, Regulatory Affairs CMC Combination Products and Medical Devices Cambridge MA United States ------------------------------

From : Communities>>Regulatory Open Forum
I disagree with Richard. I just had a conversation with the COVID-19 hotline (11:45 am, May 7) and asked about this issue after having read an update from the FDA that said UDIs for EUA devices are waived and GMPs are under limited enforcement. The person I spoke with said the update is correct and that UDIs are waived for EUA devices.  Feel free to contact me if you have any questions.  Bob Bard ------------------------------ Robert Bard JD, RAC [Managing Director] South Lyon MI United States - [More]

From : Communities>>Regulatory Open Forum
Hi everyone, As currently drafted,  the 2020 Chinese Pharmacopeia, the benchmark publication on the safety and efficacy of pharmaceuticals legally available in China, includes 319 new entries. The publication includes more than 5,500 traditional Chinese and Western medicines. The official compendium of the standards of purity, description, test, dosage, precaution, storage, and the strength for each drug legally marketed in China is published by the Chinese Pharmacopoeia Commission. It is designed [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous I'd recommend a statement that you are using these standards as general use. A Declaration of Conformity allows you to submit less testing information, but FDA still may request it. In the case of the standards you mentioned, FDA will require that information (e.g. software documentation, risk management, etc). So I would not bother with the DoC as you still have to submit all that material. Here was a nice thread discussing the topic [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous When this was first issued we printed it out, filled in the answers with careful handwriting and then scanned it back in - which seemed to be perfectly acceptable. Since then we've converted their form to a fillable PDF.​

From : Communities>>Regulatory Open Forum
Hello,  I can see many unapproved combinations of Minoxidil as topical solution like minoxidil+ Azelaic Acid; Minoxidil + Finasteride; Minoxdil+ niacin+retinol+caffeine that are available online for sale in US but these drug products are not approved by FDA as visble from USFDA website.  Can anyone explain that is there any mechanism or guideline to allows to sell such unapproved drug products online in US and also in EU? Or is this totally illegal practice?  Thanks Ankur RAC

From : Communities>>Regulatory Open Forum
Bob, I stand corrected; if you confirmed with FDA that is good.  From what I was reading and seeing (I must have missed that update) there was nothing addressing UDI or no UDI.for EUA products.  (Personally I am a bit surprised at this since the whole concept of UDI is traceability and they waive this for emergency use products - when there is an issue this is where UDI becomes so important.  Shrugs.) ------------------------------ Richard Vincins RAC Vice President Global Regulatory Affairs --- [More]

From : Communities>>Regulatory Open Forum
Hi, Ankur - Some may be "legal," others not. It's a big industry, and it is fair to be cynical. Combination products for sale that have not been approved-as the combination-by FDA are just that, unapproved drugs. I assume you checked for the approval status in FDA's "Orange Book" (https://www.accessdata.fda.gov/scripts/cder/ob/index.cfm). Even if both active pharmaceutical ingredients in a 2-drug mixture were approved separately on their own, it does not mean the combined product is approved for [More]

From : Communities>>Regulatory Open Forum
Hello Richard, Yesterday, I received a follow up from the Hotline (CDRH-EUA-Templates ) to my query. I was reminded that the waiver to good manufacturing practice and labeling requirements were included in the individual authorization letter. The person responding to my question concerning the UDI requirement provided the following: UDI is not specifically noted; however we are not enforcing UDI during the emergency. The specific authorization letter I was reviewing was for [More]

From : Communities>>Regulatory Open Forum
Hello Anonymous  You will be generating software documents (which is data of a sort), in accordance  with  ANSI-AAMI IEC 62304, and there is output from ISO 14971 which goes into the submission.   I just think DoCs are wasteful busy time and would do as few as possible. Regarding IEC 62366-1, maybe if you want mention it and do a DoC, but if the device  usability  study is not required in a submission don't  put it in there unless asked.  Just my opinion. Biocompatibility if used, is generating test [More]

From : Communities>>Regulatory Open Forum
Thank you!!! Good to know that everyone is having a wonderful interactive experience. --------------------------------- Beverly Whitaker Beaufort SC United States ---------------------------------

From : Communities>>Regulatory Open Forum
These are all unapproved new drugs. Many people who have very limited knowledge of our OTC drug system, assume that if it is sold OTC, it is a monographed drug and they can change the formulation. They do not know that there are two types of OTC drugs allowed-compliance with a monograph or NDA. Minoxidil is one and chlorhexidine antiseptic wash is another. ------------------------------ David Steinberg,FRAPS President Steinberg & Associates, Inc. Pompton Plains NJ USA 609-902-8860 -------------- [More]

From : Communities>>Regulatory Open Forum
The only  possible way I can see any of these products being legally marketed in the US without going the OTC NDA route would be if the ingredients  other than Minoxidil are considered "inactive" and have some purpose (other than their active ingredient purposes) in the formulation.  That said, this might work for the last combination in your listing because all of these can and are often used in OTC products as inactive ingredients with understood and current reasons for existing in a formulation [More]

From : Communities>>Regulatory Open Forum
This message was posted by a user wishing to remain anonymous For device-lead drug combination products, is there any difference in the quality (grade) of API used compared to a pure drug product? The cGMP guidance for combination products does not seem to specify, and since drug claims cannot be made on device-lead drug combination products, it was not clear what quality of drug is required. Thank you!

From : Communities>>Regulatory Open Forum
Hi @Britta Cyron , Thanks for your question. Let me connect with m​y RAPS colleagues on this to get you an answer and then I will follow-up with you directly. Best, Annie ------------------------------ Annie O'Brien Community Manager Regulatory Affairs Professional Society regex@raps.org ------------------------------

From : Communities>>Regulatory Open Forum
​I doubt FDA would have any willingness to change the requirements or expectations for a drug product based on whether it is in a strictly drug product versus in a combination product.  The fact also that there is not a published allowance for this is further evidence that FDA expects that the drug will meet the requirements as expected for drug products without providing any allowed changes or classes of changes.  Remember, FDA expects that drug products meet specific requirements.  Things like [More]

From : Communities>>Regulatory Open Forum
Hello, The EUA is much faster than the 510(k) process.  However, the EUA intended uses are only authorized during the state of emergency.  Once the state of emergency ends so does your authorization for the EUA intended uses.  The 510(k) clearance is permanent and authorizes the product with its cleared intended uses, to be put into interstate commerce. Hope that helps. ------------------------------ William Coulston PMP, MS, RAC Quality & Regulatory Manager San Antonio TX United States -------- [More]

From : Communities>>Regulatory Open Forum
Annie: Thank you for sharing this news.  I am curious whether the Board considers this a limited exception or a potential new normal option going forward? Scott ------------------------------ Scott Bishop Houston TX United States ------------------------------ ------------------------------------------- Original Message: Sent: 04-May-2020 08:50 From: Annie O'Brien Subject: New: Take the RAC Exams Online this Summer! The RAC board has been working hard to find solutions offering more flexibility [More]

From : Communities>>Regulatory Open Forum
Yes, you will need to achieve a 510(k) clearance after the emergency use has been officially ended by the FDA as William mentions.  Much of the information is the same, but the review process is intended to be expedited.  If you want to continue selling the product in the United States after the emergency use, you should really submit a 510(k) now; while the virus issue may continue for a few months it will take a few months for 510(k) clearance.  And if you have an EUA Approval this really is not [More]

From : Communities>>Regulatory Open Forum
Hello, I agree with Ginger, when you look at standards there will most likely be an output of documents from following those standards, i.e. risk management file, usability report, all the software documentation.  These would be included in the different sections of the 510(k) so you can claim them as recognised standards you are following.  I have mentioned in previous posts, we take a simple approach for the declaration of conformity to standards that is a small table describing what we are complying, [More]

From : Communities>>Regulatory Open Forum
Thank you for posting this here Annie as the webcast was excellent (as would be expected from Dr. Akra haha) - but really it was great to have this publicly available as there was nice information about the EU MDR conveyed. ------------------------------ Richard Vincins RAC Vice President Global Regulatory Affairs ------------------------------

From : Communities>>Regulatory Open Forum
These types of products and combinations you mention are all unapproved drugs and unapproved combinations.  Unless the specific combination is approved or listed in an OTC monograph, it is a new drug and requires a NDA to market it.  Minoxidil is a Rx to OTC switch product so it requires a NDA or ANDA to market this drug in the US, even as a OTC drug.  Thus any combination with minoxidil is a new drug. In the past the FDA has also specifically stated that combining different types of products (drug [More]

Is data integrity music to your ears?  Ours, too!

ALCOA, GAMP, Part 11, GIGO, we cover it all.
(Sung to the tune of Simon and Garfunkel's "The Sound of Silence.")

By Laurie Meehan

“I can’t get the IWRS to assign a kit number.”

“My ECG reports take forever to come back from the Core Lab.”

“The eCRF won’t let me create a new subject.”

“This stupid machine is blinking an error code again.”

Sound familiar?  Sprinkle in some colorful adjectives and it probably does -- these problems are common enough at clinical research sites.  Equipment and systems have become increasingly technical and specialized, and study site staff has had to contend with more technology than ever before.  And because of the proliferation of niche vendors who provide the new tech, sites have had to deal with more vendors than ever before, too.  



And how are problems like these typically resolved?  Someone at the study site works his/her way through a list of maybe 20 or more vendor contact numbers, places a call, navigates a series of menu options, and hopefully gets directed to someone who can help.  And that assumes the site calls the right company; with tightly integrated systems, it’s not always obvious in which vendor’s system the problem lies.  This is frustrating for sites.  It takes time.  It costs money (since “vendor wrangling” is seldom sufficiently covered in the budget).  And it keeps study staff from doing what study staff does best – run the study, work with the study volunteers, and keep them safe.

So what’s the solution? 

Hint: It’s Not Training
Calm down.  Of course, adequate training on equipment and systems is important. But training doesn’t solve every problem.  Training doesn’t keep equipment from malfunctioning.  Training doesn’t ensure vendors deliver what and when they’ve promised.  Training can’t anticipate every situation nor address an unusual site circumstance.  And training doesn’t turn people into infallible little machines; we make mistakes.  And so, in all these cases, we’re back to site personnel interacting with perhaps scores of vendors, by phone or email, all over the world.

The Solution: a Single Point of Contact
Q: How do you help sites interact with dozens of vendors?
A:  You don’t.  You do it for them.  Establish a single point of contact within the Sponsor* organization for a site to call when vendor issues arise. 

Why is this a good idea when the expertise to resolve the issue lies with the vendor?  Why is this a good idea when the introduction of a middleman may result in some inefficiencies?

Excellent questions.  Here are our responses. 

• Better Vendor Oversight.  When sites filter their vendor issues through the Sponsor, the Sponsor can more easily track vendor performance.  Are there vendors that provide low-quality solutions, are repeatedly late, or difficult to deal with?  At best, these vendors are wasting time and money, and aren’t good for business (let alone site relations).  At worst, these vendors are jeopardizing subject safety or study data integrity, and require immediate Sponsor intervention.

• Better Site Oversight.  When sites filter their vendor issues through the Sponsor, the Sponsor can more easily track site performance.  Are there sites that routinely use equipment and computer systems incorrectly?  (Yes, now’s the time for that training.)  Are there high-performing sites that are able to work independently?  This information has always been important, but in an RBM paradigm, it’s essential.  Adaptive monitoring plans rely on on-going site performance measurements so Sponsors can adjust resources accordingly.  A reduction in monitoring visits means less opportunity to assess a site’s comfort level with study technology.  The corollary of “if it ain’t broke, don’t fix it” is “if you don’t know it’s broke, you can’t fix it.”

• Ability to Identify Pervasive Problems. After the third or fourth site reports the same problem, it’s clear that this is not an isolated occurrence.  Knowing that, the Sponsor can work with the vendor to resolve the problem before other sites experience the same troubles.

• Better Functioning Sites.  We have a saying: “The Site Comes First."™  In our experience, all things being equal, Sponsors that put their sites first -- make things as easy as possible for the study coordinators -- get the best results.  They also build the good relationships that keep the best sites coming back to work on future studies.

• Better Functioning Vendors.  The efficiencies for the vendor here are clear.  Who wouldn’t rather interact with a single point of contact than field individual calls from multiple study sites?  Plus, with far fewer players, miscommunicating both problem descriptions and problem solutions is less likely to occur.  The Sponsor contact and the vendor contacts will eventually settle into common terminology and build a history regarding past issues and resolutions.

What Do You Think?
We know that not everyone espouses this idea, and we recognize there are probably other effective processes out there.  Sponsors, how do you help your sites deal with multiple vendors?  Sites, do you have experiences and/or suggestions you can share?  (Be kind, anonymize!)  Leave a comment here, visit our website, or send us an email.




____________________
*When we use the term “Sponsors” in this post, we’re including CROs that take on Vendor Management responsibilities on behalf of Sponsors.

By Laurie Meehan

SOP revision. It falls somewhere between income tax prep and colonoscopy prep on the likability scale.  So why would you want to read about it?  Maybe you’re hoping someone’s figured out a way to make the process more efficient and less painful.  Maybe we have.

The SWAT Technique

Last month, we worked with a company to revise a set of SOPs using a technique we call SWAT.  (Any edgy appeal that name might have otherwise had will be immediately dulled by its acronym expansion: “SOP Working Analysis Team.”  It’s the best we could do.  Don’t judge.)

The goal of the SWAT technique is to revise the most documents in the least time, while preserving friendships, sobriety, and original hair color.  The heart of SWAT is an immersive, multi-day working session in which participants discuss SOP revisions and incorporate them in real time.  Careful planning, thorough preparation, and commitment from management and participants are keys to keeping the SWAT session productive.

It’s Not For Everyone

Up front, we need to say that SWAT won’t work for every organization.  While the size of the company may not be important, the size of the working team needs to be fairly small.  Also SWAT won’t work for every set of SOPs.  The documents need to be part of a natural grouping – a set of similar procedures – and not a random collection.

But in the right situations, SWAT works very well.  Last month, we conducted a 2-day SWAT session with a client’s QA department to revise a set of 10 auditing SOPs.  We’ve also successfully used the technique with ClinOps teams, for example, to revise sets of monitoring SOPs.

SWAT Planning and Preparation

The SWAT process begins with central planning.  A coordination team selects a logical grouping of SOPs to revise, and assembles a list of specific revisions to be made.  Where it’s not possible to provide specific revisions, instructions and guidelines are developed, such as “remove audit report distribution details” or “update to reflect new file safeguarding practices.”

Each SWAT participant is assigned an SOP from the revision set.  The participant doesn’t need to be the author of record, but must be knowledgeable enough to “represent” the SOP – to learn the document well and understand how it’s similar to the other SOPs in the revision set and in what ways it’s unique.  Based on this understanding, prior to the SWAT session, participants make applicable revisions to their individual documents using the information received from the coordination team.  Participants should also note questions and any open issues appropriate for SWAT discussion using inline comments. 

SWAT Session

The result of the SWAT session is a set of approval-ready SOPs.  The precise structure of the SWAT session to get you there depends on a variety of factors, such as how similar or dissimilar the SOPs are, the extent and complexity of the revisions, and whether subject matter expertise is concentrated or distributed among the group.  But all successful SWAT sessions we’ve conducted share these attributes:

• Duration of 2 to 3 days.  Just long enough to accomplish the aggressive goal, just short enough to keep everyone from diving out the window.
• Real-time revision.  The “SOP of the hour” is projected on a screen while participants sit in front of PCs and update their assigned SOPs accordingly.
• Rigorous facilitation. It’s natural for discussions about company procedures to morph into other topics, such as business strategy or staffing requirements.  Discussion *will* get off topic.  When it does, the facilitator must act quickly to table it.  You can maintain a list of tangent topics on a flip chart, schedule a meeting to discuss the most pressing items, ring a cowbell, blow an air horn, or drop a quarter in the “Diversion Jar” and move on, but keep those conversations out of your SWAT session.  Save the war stories for dinner.
• Commitment to the process.  Scheduling the session is one thing, but remaining dedicated to the session is an act of will. It’s so ridiculously easy for outside work to creep in.  Management and participants must be committed to carving out the time and keeping the barbarians at the gate.
• Of course: Plenty of caffeine and yummy treats.

If you’ve ever worked on SOPs, you know there’s a big difference between done and almost done.  To help ensure you emerge from the SWAT session with the former, time must be allotted for participants to format, polish, and conduct a quality review.  If it’s possible to scare up some on-site administrative support, that could help expedite the process.

SWAT Benefits

When you look on your team’s Outlook calendar and see 3 entire days blocked out, it can seem like an awful lot of time devoted to SOP revision.  But SWAT really doesn’t take any longer than the usual process, it’s just more obvious.  Does SWAT take significantly *less* time?  Mmmm, not sure, but SWAT brings with it other benefits.

SWAT produces a more consistent set of SOPs.  Since every document is compared to every other, it’s easy to notice and correct incidental differences.

SWAT is a cross-training opportunity.  Participants enter SWAT knowing their own SOP very well.  They leave knowing the whole SOP revision set very well.

SWAT gets it done.  Auditors, how many times have you cited facilities for failure to revise their SOPs within the specified window?  It’s not because there’s a willful disregard for SOP procedures.  It’s because, in the real world of work, revising SOPs is seldom prioritized highly enough to get on anyone’s schedule until the end of the revision window encroaches or – oops – has passed.  But schedule a SWAT and they will come. (And because the effort is so visible and so obviously resource-intensive, no one wants to be the one to drop the ball.  Participants come prepared and the resulting documents are the better for it.)

SWAT is a lot more fun.  Revising SOPs on your own is really boring.  Revising them in immersive sessions with colleagues is significantly more enjoyable.  Gallows humor reigns supreme.  Copious amounts of chocolate are consumed.  Air horns are blown in celebration.  Friendships, sobriety, and hair color remain intact.  Participants live to write another day.



_______________________________________________________________________
Photo Credit:  Tenaciousme CoffeeArt, under Creative Commons License

What if your favorite movie quotes were written for QA professionals? Would they be as memorable? We think so, but we’ll let you decide.

In the fall of 2015, the internet was rife with tweets sporting the hashtag #ScienceMovieQuotes.  Creative scientists repurposed their favorite movie quotes, gleefully infusing them with nerdy humor for the entertainment of their colleagues.  Such a great idea was just asking to be stolen.  And who are we to resist the siren call of piracy?  So here’s our best attempt at making #QAmovieQuotes go viral.*

…And because the rhymes were just too good, we couldn’t resist…




If you’re feeling creative, here are the American Film Institute’s 100 greatest movie quotes of all time.  Please share your humor!  (Fair warning – we took all the good ones.)

By Laurie Meehan

________________________________________________
* Thanks to Robyn Barnes of MasterControl for this fun idea.

Photo credits

Brando: User:Aggiorna / CC BY-SA-3.0, changes made
Badge: User:Dandvsp / Wikipedia Commons / CC BY-SA-3.0
Nicholson: User:Nikita~commonswiki / CC BY-SA-2.5, changes made
Shawn: Sam Felder / CC BY-SA-2.5, changes made
Leigh: Trailer Screenshot, A Streetcar Names Desire,1951, Public domain
Freeman: User:FRZ / CC BY-SA-2.5, changes made
Aladdin Chocolates: Hans Lindqvist, 2009, Public domain
Flower: Walt Disney, Bambi, 1942, Public Domain
Doune Castle: Keith Salveson / CC BY-SA-2.0
Bogart: Trailer Screenshot, Casablanca,1942, Public domain
Newman: Warner Bros. Entertainment, Cool Hand Luke, 1967, Public Domain

Impossible to write a love song about FDA warehousing regulations, you say?
Challenge accepted.

(Sung to the tune of Billy Joel's "She's Always A Woman.")

Anx·i·ety (noun)
The state of uneasiness caused by apprehension of possible misfortune.

Yep.  That’s the word that comes to mind whenever anyone mentions FDA inspections.

But anxiety often stems from a lack of control, and in a regulatory inspection, you have more control than you might think.  There are many steps you can take -- before, during, and even after an inspection is over -- that can give you a fair degree of control over the outcome.   Here, Polaris auditors Lauren Kelley and Michele Commins share some of those steps with you.



Pre-inspection Preparation
For-cause inspections may be unannounced, but routine FDA inspections of submission data are scheduled in advance*.  That means most inspections are not pop quizzes; they’re final exams.
Remember how happy you were when a teacher gave you access to a prior year’s exam to study from?  You knew the type of questions that would be asked.  You knew how to prepare.

So this is the first tip we’d like to share.  FDA has, indeed, given you a copy of their exam in advance, in the form of its Compliance Program Guidance Manual, CPGM 7348.811.  This is the document all FDA field investigators use to conduct inspections at clinical sites.  It outlines in great detail what documents investigators will review, what dates they’re going to verify, what processes they’ll evaluate, what data they’ll collect, and what records they’re going to compare.  Despite its rather uninspired title, this is your copy of the final exam.

You know cramming is a risky strategy, so the earlier you get familiar with the CPGM the better.  Inspection readiness is a state of preparedness more than it is a laundry list of activities; it takes some time to get there.

When the Inspector’s in the House
According to the CPGM, one of the first pieces of information the FDA investigator will obtain is a list of all of the studies performed by the clinical investigator, including protocol number, sponsor, and study dates.  So even though FDA has scheduled its inspection with you, and has told you what study the investigator is coming to inspect, any study is fair game.  An FDA investigator can look at any document she wants, or talk to any staff member he chooses, whether related to the “assigned” study or not.

Most of your preparation will have been study-specific; questions about other studies will catch your staff off-guard, and a review of records for other studies may find them less than inspection-ready.  So here’s our second tip.   Avoid anything that might pique the investigator’s curiosity about a study that is not the original subject of the inspection.  Make sure the room you reserve as your investigator’s “home base” is free of any documents, reports, notes, phone lists, and post-its.  Make sure you tidy up offices, workspaces, and facilities site-wide, and keep extraneous chatter in check.

After the Visit
If your FDA inspection resulted in zero observations, then stop reading, thank your awesome staff members, and go celebrate.  If, however, you did receive a Form FDA 483, it’s probably not the end of the world, but you do have some work to do.  Our third tip is this:  remember that the sponsor/CRO is your ally here.  They have as much invested in FDA’s assessment of your study data as you do, and they have the regulatory, QA, even legal resources that you might not.   You’re not required to formally respond to 483s, but if you do, you’re likely to receive a more favorable Establishment Inspection Report (EIR) in the end.  Let your sponsor/CRO help you with your response.

Tips Do Not a Plan Make
Tips are helpful, but you’ll need more than that to ensure a successful FDA site inspection.  You need an inspection readiness plan -- a plan that you document and keep current.  All site staff members need to train on the inspection procedures and the individual roles they will play.  (Fourth tip: don’t forget to train your temporary employees; an office temp working at the receptionist desk could be the first person your FDA investigator speaks with.)

A Last Thought
Inspections are stress-inducing events, and nervous people make mistakes.  Investigators know this, and expertly exercise the “pregnant pause,” knowing how difficult it is for people to withstand an excruciating silence without volunteering unsolicited information.

So one last tip:  conduct a mock inspection before the FDA comes to visit.  It will stress test your procedures and identify improvements you need to implement.  A thorough mock inspection will give staff members an opportunity to rehearse their roles and interview techniques so they can execute your plan and speak to the FDA investigator with confidence.

_______________________________
* For-cause inspections are also known as Investigator-oriented, and routine inspections are also known as study-oriented.

 A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites

What can small sponsors do to secure the outsourcing resources they need as large CROs form strategic alliances with Big Pharma?

Partenships between large pharmaceutical companies and large CROs have become the norm.  The advantages for sponsor companies include shared risk, knowledge transfer, dedicated resources, shorter time to market, and the ability to implement the massive data integration that clinical development requires.  Strategic alliances are arguably as advantageous for their outsourcing partners, providing a steady pipeline of work that’s larger in scope and longer in duration than is typical under traditional arrangements.



Strategic Partnerships in Big Pharma: Implications for the Rest
Advantages for one segment of the industry can introduce disadvantages for another.  Alliances among the large players increase competition for top-drawer CRO resources. Smaller sponsors may find it more difficult to receive the quality of service and level of commitment they might otherwise expect.  A large CRO is likely to assign their most talented personnel to projects associated with their strategic partners.  And if a partner study were to run into trouble, it would be hard to fault a CRO for pulling experienced staff members off a smaller project in order to help out with the big client.  Though a reputable CRO wouldn’t jeopardize the relationship with the smaller client, their responsiveness to routine requests might suffer.  It might take longer to get a question answered, receive requested documentation, making the job of vendor oversight difficult.

Though selecting a large, well-established CRO at the outset may have seemed like the safe bet, what do you do if you’re a small sponsor or biotech start-up who is dissatisfied with the level of service you’re receiving?

“Let’s Bring It In-house.”
Put off by a negative experience, many companies decide to curtail outsourcing, and bring functions like monitoring and project management in-house.

This response is understandable, but it rarely goes well.  There’s good reason to outsource study functions to a CRO, especially if you’re small, or new, or both.  Mid-study is a terrible time to realize you’re in over your head.  You may find it difficult to contract with the service providers you want in the timeframe you need them.  Services you would have preferred be performed by a single company may now have to be farmed out piecemeal, which has the overhead of multiple contracts and makes vendor oversight more difficult to manage.  You don’t have time to go through a thorough qualification process.  You’re not in a good bargaining position; you’re trying to buy a new car after they’ve towed away your old one.  And now you have to rely on your new service provider(s) – the ones who may not be your first choice, whom you had to choose in haste, whom you didn’t get to thoroughly vet – to jump in midstream and pick up a study that is already in trouble.

Options for Small Sponsors and Start-ups
So what’s the answer?  You have several good options we’ve seen work well for smaller organizations.

(1) Go smaller.  Look beyond traditional outsourcing choices and consider selecting smaller vendors who may well be in a better position to focus on individual projects and give priority to shorter term engagements.  After all, a project that’s small to a big CRO will be comparatively big to a small CRO.

(2) Go long-term.  Consider establishing strategic partnerships of your own.   Doing so would increase the expertise and technology to which you’d have ready access, and could extend your global reach.

(3) Go big, but go vigilantly.  There’s a reason companies hire big, reputable CROs.  ‘Big’ means the CRO has an impressive set of resources at its disposal.  ‘Reputable’ means it has a proven record of successfully completing studies, producing reliable data, and preserving subject safety.  Smaller sponsors can still take advantage of everything a big CRO offers if they can commit to conducting very strict vendor oversight.  They need to closely monitor the quality of the work the CRO performs, frequently assess adherence to the many written study plans, and make sure deadlines are being met.  Service contracts should guarantee a certain level of responsiveness (by specifying maximum turn-around times, for example), especially for those requests that enable these oversight activities.


Qualification is Key
While the key to Option 3 is effective vendor management, the key to Options 1 and 2 is effective vendor qualification.  Resources are tight in a small company, so you need to direct them where your exposure is greatest, where they’ll do the most good.  What could be more essential to the success of your study than choosing the right company to conduct it?   Many sponsors conduct on-site vendor audits.  That’s good.  That’s necessary.  But it’s not sufficient.  To consistently choose the best possible CRO for your study, sponsors need to:

• Formally document and maintain vendor selection criteria and qualification process
• Form selection committees that represent all sides of your business – finance, contracting, operations, finance, QA, data management, pharmacovigilance, biostatistics, etc.
• Conduct on-site audits with well-trained, well-prepared QA auditors
• Track the resulting CAPA activities
• Ensure outstanding issues are resolved before the contract is signed
• Periodically re-evaluate vendors to make sure they can continue to deliver the same level of quality they’ve delivered in the past

Strategic partnerships among large companies have reshaped the research environment for industry players of every size.  Small and mid-sized companies who take the time to review current outsourcing arrangements, assess alternative models, and thoroughly qualify new vendors and partners will fare the best.

Photo Credit: FreeImages.com/Svilen Milev

Year in and year out, protocol deviations are the most common FDA Site Inspection finding. Why does this keep happening?

If you’ve seen FDA’s Inspectional Observation Summaries, you know that in 2015 the most frequently cited violation in clinical research by far was “failure to conduct research in accordance with the investigational plan.”  Do you know this finding also topped the list the year before that?  And the year before that?  In fact, deviating from the protocol has been the most common observation every year for the last decade.

Why does this keep happening?



The Nature of Protocols
This will come as a surprise to no one: not all protocols are well written.  Important procedures can be hidden in the most obscure places.  Charts depicting Time and Events Schedules are famous for carrying dozens of footnotes that appear nowhere else in the protocol, yet convey important study procedures.   For instance, a pre-dosing column may include a footnote that provides a timeframe for performing a physical exam; a post-dosing footnote might specify the interval at which vitals must be taken.   Failing to follow study procedures compromises subject safety and data integrity; FDA won’t care whether the procedures were in big bold italics or 7-point font.

This, too, may come as no surprise, but not all protocols are error-free.   Information in charts may not match the narrative.  Procedures in Section A may conflict with procedures in Section B.  When the FDA investigator spots an inconsistency, you’ll be asked which of the two conflicting procedures you followed and why.  If you performed procedure A only because you didn’t even notice there was a B, it will be clear you didn’t read the protocol as thoroughly as you needed to.  The FDA investigator may become concerned that your study execution differed from the sponsor’s intention.  This is not a concern you want to trigger.

For these reasons, it’s imperative that study staff read and understand the protocol.  Study team members need to ask questions about anything they’re unsure of, seek clarification on protocol inconsistencies, and get responses that satisfy before starting the study.   A PowerPoint overview is not sufficient training.

One more irksome attribute of protocols that can make them difficult to follow -- they change.  While most study sites allocate time and resources for initial protocol training, many lack a plan for training staff on protocol amendments.   A disproportionate number of protocol deviations occur in amended procedures, and it’s often because staff members have been insufficiently trained on them.  (And when you do train on protocol amendments, don’t forget to document it.)

Deviation Temptation
A protocol is not a suggestion; PIs cannot substitute their own judgment for prescribed procedures, no matter how well-intentioned the departure.  The protocol for a psoriasis study might call for the PI to perform a series of punch biopsies, very invasive procedures.  After the first biopsy, an empathetic PI might be tempted to skip a second if he observes the plaque is clearing up; the drug is working.  But this would be a protocol deviation.  The protocol for another study might preclude the use of a particular drug, even though the drug is routinely used throughout the practice to treat a symptom that a study participant is exhibiting.  But the study protocol trumps standard of care; prescribing the drug would be a protocol deviation.

A PI who feels she must deviate from the protocol for some reason must obtain prior approval, since failure to follow the protocol can jeopardize the reliability of the study data, if not subject rights and safety.



Deviations Happen
So you’ve thoroughly read the protocol, you’ve asked your questions and received the necessary clarifications, you’ve trained your staff on the protocol and its amendments, and you do your best to follow them.

Despite all your preparation and vigilance, protocol deviations happen.  They just do.  And when they do, here are two don'ts.

(1) Don’t panic.

(2) Don’t let an FDA investigator find them first.
Take the time to fully document any protocol deviations.  Be sure to record why they happened, how they were corrected, and what was submitted to the IRB.

[Note: IRBs have different requirements about what types of protocol deviations should be communicated.  Out-of-window visits are common and are frequently considered too minor to report.  But nothing’s black and white.  If the missed visit resulted in missed doses, that would probably change the calculus. The PI needs to determine whether to notify the IRB, and if no submission is thought necessary, it’s a good idea to document why not.]

_______________________________________________________________

A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites.

While patients are consumers of healthcare services, they can’t be considered customers in the traditional sense. The same is true of students. Over many years of teaching, I’ve noticed this parallel between the healthcare and education professions; both require significantly more “customer participation” to achieve desired outcomes than other industries do. That’s one reason it’s difficult to measure the quality of these institutions and the skills of their practitioners. That’s also why both industries focus so intently on engaging our communities; we simply can’t be successful unless we do.

“Can You Hear Me Now?”
As the old joke goes, there are 3 types of people in this world: those who are good at math and those who aren’t. Many students believe themselves to be permanent denizens of the 2nd camp. They find mathematical concepts confusing and the terminology inscrutable, so they tend not to ask questions. They’re afraid they’re being judged, so they’re not always truthful. Tests and exams fill them with anxiety, and sometimes even panic (no doubt waking to nightmares of trains leaving stations at varying rates of speed). These are the students who need my help the most. Our success in overcoming these challenges together will depend heavily on the student/teacher connection we can establish, yet few students are actually able to choose the teacher with whom they are asked to connect. Sound like healthcare yet?



So it’s no surprise that trends toward greater patient engagement in healthcare, and patient-centricity in clinical research, emphasize clear and compassionate communication. Doctors, like instructors, need to explain concepts in relatable terms, encourage and address questions, assuage unwarranted anxiety, and establish trust. Until that happens, a meaningful partnership isn’t even possible.

When the Cat’s Away, Will the Mice Make Good Choices?
You may remember that old college rule of thumb: 1 hour of class requires 3 hours of study. This means instructors have just 25% of their students’ time to inspire the behaviors and habits that will make a success of the other 75%. “Don’t be the Sage on the Stage,” the mantra goes, “be the Guide on the Side.” If you’ve ever taught in an academic setting, you know how challenging that can be. The role of lecturer is fairly obvious, but the role of coach is nuanced; it evolves over time and it’s different for everyone.

And if a college instructor has just 3 hours of face time a week, a physician is lucky to have 3 hours of face time a year. That’s not much time to persuade, convince, and encourage the lifestyle choices and medication adherence essential to maintaining good health. And when you consider that a good part of each office visit is spent performing examinations and assessments, it’s easy to understand the excitement surrounding mobile health technologies. Beyond delivering real-time, real-world data, smartphone apps can send patients important reminders, make complying with diet and exercise recommendations easier, and make progress toward fitness goals visible.

“And the Survey Says…?”
Most service industries are rightly concerned with customer satisfaction – how to achieve it, how to measure it, and how to improve it. So last year, an article entitled “The Problem with Satisfied Patients” caught my eye. The Atlantic article concluded that higher hospital satisfaction ratings don’t necessarily correlate with better healthcare. A five-star student course evaluation can be similarly misleading. Pleasing a student is not the same thing as teaching a student, just as making people happy doesn’t make them well. That’s not to say that hospitals and colleges shouldn’t solicit feedback; of course they need to understand the perspective of the communities they serve. But healthcare facilities and schools should give satisfaction surveys their proper weight or they risk implementing changes that consume resources but do nothing to improve a patient’s health or increase a student’s proficiency.

Outcomes-based Evaluation
So if outcomes are paramount in both medicine and academia, it follows that the quality of care and education would be best measured by evaluating those outcomes. Right?  Well, it’s a good place to start, but since patients and students share responsibility for success with their doctors and teachers, an individual outcome may be misleading. An instructor can influence, but can’t control, whether a student works on practice problems, studies for tests, asks questions, or even pays attention. A doctor can’t control whether a patient takes a prescription, follows medical advice, or reports relevant symptoms. There isn’t always a straight line between quality of service and success rate.


College instructors try to keep their students engaged by tailoring their coaching styles, offering a mix of delivery methods, seeking out fresh ideas to make the concepts relevant, and maintaining convenient office hours. Looking to improve patient engagement, healthcare systems have found that many people face situations that prevent them from keeping appointments and following medical advice. Some organizations are now providing copay assistance, arranging transportation, and employing patient care coordinators to place routine monitoring calls. None of these services are free, but they can be considerably less expensive than eating the costs associated with hospital readmissions.

The Partnership Starts Here
Teachers want their students to learn and healthcare providers want their patients to be well, but students and patients must actively participate in order to meet those goals. Handing out easy A’s and offering gourmet hospital menu items in response to survey responses won’t cut it.

Success begins with clear, compassionate communication – communication designed to explain complex concepts, to build trust, and to encourage the behaviors that lead to positive results. Understanding the challenges students and patients face enables educators and medical professionals to offer practical, meaningful solutions that can actually improve outcomes.

[In case you missed it, our last blog post was about the most common site inspection finding every year for the last decade: Protocol Deviations and How to Avoid Them.]

As a sponsor or CRO, you understand the importance of a thorough site selection process. A site needs to be able to meet enrollment targets and time frames, protect the rights and safety of study participants, execute the protocol, deliver quality data, and maintain GCP compliance. That’s what your site feasibility surveys and pre-study visits are designed to evaluate. And as you’re assessing a site’s abilities, the site is conducting its own feasibility process. They’re mining their patient database and assessing inclusion/exclusion criteria. They’re reviewing staff credentials and ensuring they have adequate resources to manage the number of subject visits and collect the data the protocol requires.

But when we conduct GCP audits, we find there’s one perspective that is sometimes overlooked by both sides: the needs of the study drug itself.




Study Drug Attributes Affecting Site Selection Process

IP Environment.  Aside from needing sufficient storage space, many drugs have special storage requirements. Does the site have the equipment and resources needed to maintain and adequately monitor and record environmental conditions such as temperature or humidity? Do they have agreements with their vendors that guarantee a specific response time for repairing or replacing faulty equipment? If they lose electricity, do they have back up power, or at least provisions to move the IP off-site? (This is a common auditor question in hurricane-prone areas.)


Preparation of Study Drug.  Does your investigational product need to be reconstituted in a liquid? Do doses need to be compounded in different concentrations? Does the protocol require that an IV solution be prepared, filtered, and sterilized? These activities take time, specially trained personnel, and sometimes specialized equipment such as ventilation hoods. If your protocol demands an involved IP prep, your feasibility survey must include questions that allow you to assess these site capabilities and your pre-study visit should definitely include some time in the pharmacy. 

Drug Administration. Handing over a bottle of capsules to a study participant is one thing; inserting a butterfly catheter into an antecubital vein is something else again. If drug administration is very invasive, you’ll want to verify that the site has taken this into account when providing you enrollment projections. During subject visits, staff members may have to calculate doses, give intramuscular injections, perform infusions, or conduct sterilization procedures. You’ll want to verify that site staff has this expertise if required. Some clinical trials require a blinded dispenser who cannot be involved in any other study procedure or activities. If so, does the site have the resources for this?

Site Selection: it’s not just the PI, it’s the IP too
The study success and patient safety are jeopardized when a site can’t meet its enrollment target or doesn’t have the resources to execute the protocol. IP requirements can affect a site’s ability to do both. It’s critical that your site selection process – both your feasibility questionnaire and your pre-study visit – evaluate how well the site can meet the storage, preparation, and administration requirements of the study drug.

__________________________________________________________________________
A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites.

Photo Credit: By Harmid (Own work) [Public domain], via Wikimedia Commons

Developing safe and effective drugs requires a coordinated effort across a diverse set of disciplines. This is easier to observe at some points in the process than at others. Once a product is well into human trials, it can be easy to forget that developments on the manufacturing side of the house can affect the clinicians who are conducting the studies.




Trialed Drug vs Marketed Drug


Once researchers are satisfied that animal studies show that an Active Pharmaceutical Ingredient (API) is effective and nontoxic at initial doses, there’s an urgency to get it into the clinic and begin human studies as soon as possible. Though the ultimate product may be marketed in one form, a different form may take less time to manufacture, and so would be the form given to human volunteers in earlier clinical trials.

A tablet, for example, is much harder to manufacture than a 2-piece hard shell capsule because determining the appropriate compression for a tablet takes time. (Tablets that aren’t sufficiently compressed will break apart in the bottle; tablets compressed too tightly may not dissolve as they should, earning themselves the entertainingly accurate moniker “bedpan bullets.”) Rather than wait until a tablet form of the drug can be fully developed, to save time, sponsors would likely begin human studies using a hard shell capsule version.*

To ensure that clinical trial data for the Investigational Product (IP) are applicable to the ultimately marketed product, clinicians run bioequivalence for dosage form studies. These small pharmacokinetics studies may result in changes, such as dosage amount or frequency, if people do not metabolize the studied formulation and the final formulation the same way.


Stability Test Failures

When we hear of a pharmaceutical company having to “pull its product,” we typically think of a recall scenario that involves consumers, distributers, and retailers.  Recall procedures fall under the GMP umbrella, and are spelled out in great detail in 21 CFR Part 211. However, similar procedures may very well be required of clinical site staff, long before the product ever sees its first drugstore.


Before any clinical trials begin on a drug, manufacturers would have been conducting stability tests for months. But stability testing may continue for years after the start of human trials, and analysts could detect a variety of troubling conditions in the course of their work. Product can change color or break apart. Capsules can crack and leak. Microbes could begin to grow, especially in moister product. The container closure system itself could be problematic; it could leech contaminating material into the product, introducing impurities, or it could extract material from the product, diminishing its potency. Any of these finding could mean that study drug would need to be pulled from clinical sites.

No one expects site staff to have detailed quarantining and recall procedures; the Sponsor will tell site staff exactly what they need to do. But what would this look like?

(1) Adulterated product that cannot be dispensed will need to be moved to a separate, secure area so it won’t be confused with good product. It might need to be stored there for a period of time or shipped back to the Sponsor.

(2) For certain, a site’s drug accountability procedures will be center stage. The only way a site can successfully recall bad product is if it has -- all along -- closely tracked the amount of IP it has received, dispensed, and still has on hand.

(3) Study participants who have any quantity of the bad product will need to be contacted, told not to use it, and told how to return it. (Note that this pertains to participants on the placebo arm as well, otherwise the blind will be broken.) Phone calls may not be sufficient; sites may need to invoke lost-to-follow-up procedures, such as sending registered letters. Remote, virtual trials, which often ship IP to participants, need to be designed to allow for the tracking and retrieval of bad product.

(4) What should be done if it turns out some participants have already used the bad product? Unfortunately, that’s one SOP you can’t write in advance; it would completely depend on the nature of the IP and the problem it has, the vulnerability of the patient population, the protocol, the participant’s proximity to the site, etc. Perhaps a careful case review to look for AEs associated with affected participants would suffice. More critical situations may require participants to undergo physical examinations or special testing. In many cases, study data associated with the use of the tainted IP would need to be identified and removed from the efficacy analysis.

(5) These quarantining and recall activities must be carefully recorded. IRBs and regulators will want written proof that all suspect IP has been accounted for. Sponsors might consider sending a CRA to ensure adequate documentation.


Re-labeling

Stability tests don’t have to fail to trigger action for clinical staff. Should a chemist discover a condition that requires a labeling modification -- a new expiry date**, for example – all the labels on existing product held at clinical study sites would need to be replaced. In these situations, the Sponsor may dispatch CRAs to replace the labels themselves, or negotiate with individual site staffs to do it instead. 


No GxP is an Island…

GMP professionals manufacture, package, and label biopharmaceutical products. GCP professionals conduct clinical trials on those same products. These roles are very different from each other, yet they don’t work in isolation. Formulation changes, stability testing, and re-labeling requirements represent three examples in which activities performed by GMP folks impact their GCP counterparts. Have you experienced any additional examples? Feel free to share them in the Comments section.

In case you missed it, our last post was about how attributes of the Study Drug influence the Site Selection and Feasibility process.

___________________________________________________________

* “By the time clinical trials start, they know what ingredients go in the cookie, they just don’t know how the cookie is going to turn out yet.”
       - Rosanne Sylvia-Heeter, Polaris Director of GMP Compliance and phenomenal cook

** Expiry dates are not required but are sometimes included on IP labels.

Q: If Notes to File can be regulatory red flags, should we quit using them?
A: No, and here's why...

Regulatory inspections are often conducted long after the conclusion of the study. When an FDA investigator asks you a question about an anomaly five years after it’s happened, will anyone recall the circumstances well enough to satisfy the regulator’s concerns? You’ll be doing yourself a huge favor if you write NTFs that answer the questions regulators might one day be asking you.



NTFs can be used to effectively explain an irregularity, locate a document, or note a change in procedures. While there are no regulations or guidances that govern NTFs per se, ICH E6(R2) 2.10 states “All clinical trial information should be recorded, handled, and stored in a way that allows its accurate reporting, interpretation and verification.” A well-written NTF will not only describe an event, but will document who made the notation and when, why the problem occurred, what was done to fix it, and what changes were made to keep it from happening in the future. That’s a lot, so it’s a good idea to develop an NTF template to remind authors to include these elements.

Example of a poorly written NTF:
Informed Consent for study BH-90210 was revised by the IRB 01/7/2017. Subject 867-5309 was not re-consented at her next study visit, as per IRB instructions.

This NTF does nothing more than document the deficiency.

Improved NTF:
Informed Consent for study BH-90210 was revised by the IRB 01/07/2017 to include lab procedures on Visit 5. IRB instructions required a re-consent for all enrolled subjects at next study visit. Subject 867-5309 was not re-consented at her next (2nd) study visit, but was re-consented at her 3rd visit.

This version of the NTF gives us a little more context and lets us know that the subject was re-consented before the new lab procedures were performed. The oversight was corrected in time to preserve Jenny’s* rights, but we still don’t know why it happened; there’s not enough information to satisfy a regulator that failure to re-consent was not a pervasive problem. What were the site’s re-consenting procedures at the time of this study? Were they being followed? Who do we ask?


Complete NTF Using Template



Since the subject was consented before the additional lab procedures were performed, there was no violation of informed consent regulations. This was an oversight with no ill-effects, not a significant break with procedures. Discussing it at the departmental meeting is an appropriate, proportional response. (Note that if the subject had not been re-consented before the new lab procedures were performed, the site would have been in violation of consent regulations and an NTF would not have been sufficient. Both the IRB and the sponsor would have needed to be informed of the failure to consent.)

A poorly written NTF – one that doesn’t provide enough information, one that identifies a problem but no solution, one that is inadequately standing in for proper record keeping – won’t satisfy a regulator’s concerns. These are the sorts of NTFs that can actually do more harm than good. A well-written NTF, on the other hand, is something your future self will thank you for.

In case you missed it, our last post was about how GMP activities affect GCP study procedures.
___________________________________________________________________

* If you know why Subject 867-5309 goes by “Jenny," one of your friends wore a pink tux with shoulder pads to prom.

A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites.

You know you need a computer systems audit, but that’s literally the extent of what you know.
Has this ever been you?

Yes, you use computers on a daily basis, and you may even use the system that needs to be audited. But you don’t spend your day thinking about where all the system components are located, how services and software are combined, and what Part 11 requirements apply. Terms like “cloud computing” make you feel slightly queasy. You’d rather get a root canal than discuss “distributed processing.” Your expertise is in manufacturing. Or clinical research. Or non-clinical lab operations. And somehow it’s your job to make sure an effective and properly-sized system audit is conducted. Great.



Yet your Quality Assurance colleagues -- whether they’re from your internal QA department or an external compliance company -- need your input. They need to understand what software is being purchased, what services are being contracted, how and where components of the system are being implemented, and how the system will be used.

The good news is that the QA auditors can help you. They know that FDA favors a risk-based approach to validation and Part 11 implementation, and they even know what that means. They love to talk about configuration management and change procedures. They love gathering evidence that demonstrates your system works correctly and is in a state of control, and they know what rocks they should look under to find and fix vulnerabilities.

What follows are examples of the types of information you need to convey to QA – and that they should be asking you about – to properly size and scope an audit.

How do You Plan to Use the System?

Suppose you need to audit the supplier of a new Document Management System. The first thing an auditor would need to understand is how you plan to use the system. How mission critical are the documents you’re looking to store?  Are they covered under regulatory scope?  Maybe you plan to use the system as a collaboration environment for developing new SOPs. That would require a relatively low level of scrutiny, especially if you only plan to print out the finalized documents for wet ink signature. (As a point of comparison, if you plan to use the system to finalize SOP approval, the auditor would need to check that Part 11 requirements for electronic signatures are properly implemented.) What if the Document Management System will be housing critical GxP documents, such as Trial Master Files, Master Schedule Sheets, or Master Batch Records? In these cases, the validation would have to be far more thorough, and Part 11 electronic record features, such as audit trails and archiving functionality, would have to be implemented and verified.

Here’s another “use” example. Similar to the term “Document Management System,” the term “Analytics System” does not tell the whole story. From a business perspective, study start up (SSU) metrics may be vital for sponsors and CROs to collect and analyze. But since they have no regulatory impact, the FDA would not require an SSU analytics system to be validated. (That doesn’t necessarily mean you might not want to, though.) On the other hand, a system that performs statistical analysis on study data for regulatory submission is about as critical as it gets, and would require thorough validation and Part 11 implementation. Other analytics systems, such as dashboards that pull data from critical systems, might fall somewhere between these two extremes.

What is the Vendor Providing? And How? And Where?

If you need to audit a complex system, the questions QA will ask you will go beyond system use. The auditors will need to understand the combination of software and services the vendor is providing, and where the software and data reside.

• Does the software and data reside internally at your company or does the vendor provide a hosting service?
  If the vendor is hosting, the auditor needs to tour the facilities and review SOPs and records to evaluate physical security, staff training, environmental controls, backup procedures, disaster recovery plans, data retention, computer infrastructure, and change control.
  
  
• Does the hosting vendor own its own servers or does it, in turn, outsource that function to a 3rd party hosting company, (possibly even in the cloud)?
  If the hosting is outsourced, ideally an auditor would be able to visit the hosting site. Failing that, the auditor would ask questions about the vendor’s qualification processes and review SOPs that govern vendor selection/management procedures. If the vendor outsources other services beyond hosting, those services might need to be considered, as well.
  
  
• Is the vendor providing any other services?
  Many EDC vendors will provide study-specific services such as screen development and data entry validation edits. Auditors would need to review SOPs for providing these services and understand how the vendor tests and manages modifications to these components as the study proceeds.
  Sometimes computer systems vendors provide ancillary services, such as help desk functions and user account management. That would mean additional SOPs and training records for the auditor to look through.

Other Considerations

There are many. For example, where are you in the product life cycle? You ask different questions about a new system than you would about one that has been operating for a few years. Is the product Commercial off-the-shelf (COTS) or highly customized? COTS systems vendors often have their own validation package which auditors would review, and then ensure proper operation in the sponsor/CRO’s specific environment. A highly customized or custom-built system would require a more extensive validation process.


The Take Away

CSV/Part 11 audits will never be standardized, cookie cutter type activities; there are simply too many factors -- in too many combinations -- to consider. You want your QA efforts to be worth the money you spend and be able to answer the questions FDA says you need to be asking. If you’re unsure how to do that, that’s ok. Other people know, as long as you can help them understand how you plan to use the system, what software and services are being supplied, and how components of the system are being implemented.

In case you missed it, our previous post was Notes 2 Fix Your Notes 2 File.
_______________________________________________
Many thinks to Lisa Olson for sharing her insights with me.

Protocol trumps practice. This principle seems clear enough, but complying with it is not always as straight-forward as it sounds. Years of practicing medicine has reinforced the way a physician responds to medical situations. But do these responses run counter to the investigational plan? Can a site’s commitment to standard of care affect its ability to meet enrollment targets?


There’s a lot to consider.



What’s Your Standard of Care?
When deciding whether or not to conduct a particular study, a PI needs to verify that the protocol is aligned with practice norms. For example, an early phase trial might exclude a medication that is part of a practice’s routine therapy. Is the study placebo-controlled? Does it feature a specific comparator drug? Will it include a washout period? Any of these elements could present enrollment challenges or preclude a site from accepting a study at all. Responsible sites want to make thoughtful decisions about study suitability; they want to provide realistic enrollment estimates. Sponsors want this too, and can help sites do both these things by providing them a sufficient level of detail about protocol procedures as early as possible.


The Road to Deviations is Often Paved with Good Intentions
Therapeutic misconception – a well-documented phenomenon in clinical research – occurs when a study participant “fails to appreciate the distinction between the imperatives of clinical research and of ordinary treatment.”* Study participants are not alone in this. Researchers blur the distinction themselves when they conduct procedures that are consistent with clinical care but deviate from the protocol. This may be particularly true for PIs who recruit participants from their own practices. An endocrinologist might ordinarily reduce dosage for a particularly diminutive patient. A pulmonologist would often skip a scheduled chest x-ray she felt wasn’t needed to avoid exposing her patient to unnecessary radiation. An orthopedic surgeon may decide his patient needs more recovery time than usual before attempting her first walk. In a clinical care setting, these decisions are sound, made in an individual patient’s best interest. In a clinical trial, if they differ from the investigational plan and haven’t been approved by the Sponsor, they’re protocol deviations.**

It May be Par for the Course, But It's Still an AE
Specialists who have experience treating particular conditions are also familiar with the complications that ordinarily accompany them. A nephrologist, for instance, knows that a patient with end-stage renal disease frequently experiences bloat from a buildup of fluid between dialysis sessions. Though useful for a doctor treating patients, this knowledge can actually work against a doctor running a trial. How? A PI may fail to report a stomach ache as an AE because it’s so typical, so expected. “Bloat is common for renal patients. If I recorded every GI incident, I’d be recording AEs all day.” At its surface, this PI’s argument sounds reasonable, but what if the study drug itself is contributing to the participant’s discomfort? In order to assess the drug’s gastrointestinal effect, the PI must document the frequency and severity of all GI events.

Lab values that are either above or below normal range are also prime candidates for AE underreporting. “Of course the participant’s liver enzyme is high – we’re testing a cholesterol drug.”

The Importance of Study Oversight
Any GCP course worth its registration fee will discuss the distinction between standard of care and the study protocol. In practice, the distinction is not always as obvious as training sessions might suggest. This is where well-trained CRAs come in. As site monitors, CRAs are in a position to catch deviations that result from lapses into standard of care. Reading through progress notes, a monitor can ensure that any untoward medical event has been reported as an Adverse Event. They can verify that procedures conducted by the PI and site staff are compliant with the protocol. Then, by reviewing which types of data must be collected and emphasizing the importance of following certain protocol procedures, monitors can take the opportunity to re-educate study personnel and help them avoid these common pitfalls.

_______________________________________________________________________
* Lidz CW, Appelbaum PS (2002) The therapeutic misconception: problems and solutions. Med Care 40: V55-V63.

**Andrew Snyder of the HealthEast Care System wrote a thoughtful piece describing the compatibilities that do exist between clinical care and clinical research. His arguments provide a useful counterpoint to the issues we’re raising here. https://firstclinical.com/journal/2017/1707_Research_vs_Care.pdf

A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites.

When I was a teenager, my grandfather would invite my new boyfriends to run short, pointless errands with him, just so he could watch them drive. He said he could tell a lot about a boy’s character simply by observing his actions behind the wheel. Did he stay under the speed limit? Did he use his signal when he was switching lanes? Did he slow down when children were playing near the road? If so, it was a good sign that the boy was generally a careful and attentive fellow. If not, it was an early indication of reckless tendencies, and I would do well to be on my guard.

What does this have to do with PI oversight?



As Sponsors and CROs, you’re sometimes forced to make site selection decisions based on a limited set of criteria that you deem to be – hope to be – reflective of the site as a whole. In a short space of time, you need to assess a PI’s commitment to study oversight. On what should your pre-study “test drive” focus to help you gauge the level of care and attention a prospective PI will devote to your study?

We have some suggestions.


Assessing Attention to Detail
Any GCP-compliant site can produce a set of current CVs, job descriptions, and training records; they’re essential documents. But the most attentive sites are able to show you more than a collection of records during your pre-study visit with them. These sites keep a complete, organized set of uniform records and can describe their tight system for maintaining it. All documents for each staff member are found in dedicated tabs inside a records binder, or are equally well-organized in an electronic records system. All CVs are in a standard format so Sponsors can easily compare qualifications across individuals. Every document is current; CVs are up to date, and there’s a system in place to track which medical licenses are expiring when. Training records are comprehensive and include training on GCP regulations, site SOPs, and EMRs.

This is not sexy stuff. That’s why it’s a good indicator of PI oversight.  A site that is disciplined enough to keep such tight control over its personnel records is likely to carry that control into all aspects of trial execution.

Assessing Commitment to Protocol Compliance
During site initiation visits, Sponsor/CRO staff is on site to conduct protocol training; all study sites start off the same in this respect. But protocol amendments are inevitable, and sometimes – though nobody’s happy about it – frequent. You need assurances that a site’s response to each amendment will be swift, well-coordinated, and deliberate. Ask the prospective PI, “What procedures does your site follow for managing protocol amendments?”

The A answer:
“When a protocol amendment arrives, we convene a special team meeting to review the changes and discuss their effects. For example, if additional safety tests are required, the team discusses who shall be delegated to perform them? Do we have adequate time scheduled into the visit for any additional procedures the amendment requires? How will I be demonstrating oversight of any new test results? Once we’ve asked and answered these kinds of questions, we document attendance at the meeting, record assignments of delegated duties, and publish meeting minutes.”

The F answer:
“I email the amendment out to my team. I assume they’re all adults and know how to read.” (#TrueStory)

Just Ask
After reviewing essential documents and protocol amendment procedures, you should ask about other PI oversight mechanisms the site has in place. A good prospective site might tell you the PI holds biweekly meetings to review the items raised during monitoring visits. A PI may block out time at regular intervals to review adverse events and other study documents, and sign off on labs. A PI who values staff excellence may actively encourage and support Study Coordinator certification; some may even require it after an initial period of employment. In the past, we’ve worked with sites that have established internal Quality Control procedures, some maintain CAPA programs, and others conduct mock inspections.

There’s a wide variety of responses that can give you confidence a prospective PI is committed to running your study in a constant state of control. Whatever oversight measures are discussed, remember to ask how they will be documented, so during the study you’ll be able to verify that each activity is being consistently carried out.

Epilogue
After running an errand with a boy I met at college, my grandfather happily reported back to me, “He didn’t roll through a single stop sign coming down Green Hill Road. He’s all right, that one.”

My grandfather, a retired police detective for the city of Pittsburgh, knew how to read a person. That boy and I celebrated our 30th anniversary last month.

I was a child bride.

If you found this article helpful, you might also like:
Anticipating Tensions Between Clinical Care and Study Protocol
Avoiding Protocol Deviations

We may call them “site inspections”, but it’s not the site that’s being inspected when a regulator visits; it’s the Principal Investigator. Though a PI typically delegates study tasks to other staff members, he or she remains solely responsible for the conduct of the study. In fact, the ICH E6(R2) addendum adds two new sections to the international guidance that emphasize PI supervision.

That’s what makes the Delegation of Authority (DoA) log so important and why regulatory inspectors care about it so much. A DoA log serves as evidence that a PI has assigned study tasks only to those staff members with the education, training, and experience to carry them out. If delegates are unqualified to perform their tasks, subject safety could be at risk and it’s highly likely that the study data would be unusable.



Monitors – you can really make a big contribution here. At the outset of the study, you can verify that your PI has made appropriate delegations and the DoA log is complete. You can cross-match the log with training records, CVs, licenses, and source documents and correct any problems as early in the study as possible. Then, throughout the study, you can verify that the DoA log is being maintained.

Coverage
Without referencing any other site document, monitors can spot two types of DoA log omissions.

(1) Missing Assignments. Are there study tasks to which no one has been delegated? The tasks in a DoA log are often represented by a short code to conserve space. A legend at the end of the log translates the code into its corresponding task. Monitors can compare the legend to the DoA log entries to see if any tasks are omitted.


(2) Gap in Assignments. Due to staff turnover, reassignment, leaves of absence, etc., delegation for a task frequently does not last the duration of the entire study. A column in the DoA log indicates the delegation start and stop date.  Monitors can check to make sure that when the delegation for a task ends for one staff member, it is picked up by another.

Qualifications
Once you’re satisfied the DoA log completely covers all tasks for the duration of the study, you can check to make sure delegates have the necessary qualifications. You’ll want to compare the log with training records, CVs, and medical licenses from the regulatory binder.

• Has the staffer charged with recording vital signs during a subject visit been formally trained to take blood pressure? Is it documented?
• Did an incoming pharmacist receive protocol training prior to the start date of his study assignments?
• Does state law allow a registered nurse to dispense investigational product, or is a nurse practitioner or physician’s assistant required? Does the protocol require only an M.D. conduct certain procedures? Does the DoA log show the requirement is being followed?

Study Procedures
Even after the focus of the monitoring visit moves past the DoA log itself, you should revisit the log during source document review.

• Have any study tasks been conducted by staff members who have not received official delegation to do so?
• Perhaps the protocol requires a blinded IP dispenser. If so, has the delegated dispenser conducted any other study procedure?

PI Oversight
The PI is responsible for ensuring subject safety, compliance with the regs and the protocol, and control of the investigational product. That obligation cannot be delegated away. PI oversight is critical to a successful study, and the DoA log is where PI oversight starts.

Procedures that are performed by unqualified or ineligible personnel put both study participants and study data at risk. These are the very things regulatory inspectors work to guard against. Good monitors know it and make verifying the DoA log a priority.

__________________
A version of this article originally appeared in InSite, the Journal of the Society for Clinical Research Sites.

True or False:

(1) eSource in clinical trials means eliminating the possibility for transcription errors.

(2) Data collected in Electronic Data Capture (EDC) systems is eSource.

Strictly speaking, both statements are false. If that surprises you, it’s probably because many casual uses of the term “eSource” actually differ from the formal definition laid out by FDA. If the participants in any discussion share the same interpretation of “eSource”, or if it’s clear from context how “eSource” is being used, then no harm, no foul. (Contemporary translation: “Meh.”) BUT…and you know where we’re going with this…when a term can be interpreted in multiple ways, there’s always a possibility for miscommunication and cross talk.



FDA Guidance on eSource in Clinical Investigations
FDA defines eSource as *any* data initially recorded in electronic format. That’s a broad definition, one that includes:
     a) equipment-generated data, such as digital imaging and labs
     b) electronic Patient Reported Outcome (ePRO) transmissions
     c) data streams from mobile health devices, such as Apple ResearchKit
     d) data entered directly into an EDC, known as Direct-Data-Entry (DDE) solutions
     e) data entered into an Electronic Health Record (EHR) or electronic Medical Record (EMR) system


Discussion of Direct-Data-Entry (DDE)
DDE systems allow research staff members to use portable devices to enter study data directly into an EDC system. DDEs have been garnering a lot of industry attention of late, and a number of companies offer solutions that offer a DDE data flow. As independent 3rd party auditors, we don’t want to play favorites by mentioning specific systems as examples, but if your company sells or uses a DDE system that you want to highlight, feel free to add a comment below to give it a shout out.

Discussion of EMR/EDC Integration
Not long after finalizing its e-Source guidance, FDA hosted a webinar that encouraged companies to explore direct EMR/EDC integration. While a few industry players have taken up the effort, movement has been slow. One difficulty: generally EMRs are built with healthcare in mind, not clinical research. Secondly, with so many EMR and EDC vendors, ensuring that EMR data from one system is mapped to appropriate EDC fields in another system relies heavily on data standards that are still being defined and need to be implemented on both sides. 

Source Data Verification (SDV)
If data is transmitted directly from the source system to an Electronic Data Collection (EDC) system, SDV is not required, since the source data isn’t being transcribed manually. (Note: other types of Source Data Review (SDR) activities are still necessary, even if SDV isn’t. SDR must be conducted to verify ALCOA-C data principles such as attribution, originality, accuracy, completeness, etc.) Direct transmission from source system to EDC system is the typical pathway for items (a) – (d) above, and so SDV is not required for these types of eSource.


Common Confusions
SDV. Unless there is EMR/EDC integration – Item (e) above – source data from an EMR system needs to be manually transcribed. This is what makes T/F question #1 false. Just because source data originates in an EMR, it does *not* suggest SDV checks are superfluous. You could argue, as many have, that SDV is not a high-value activity and uncovers only a small percent of data error. That argument may well influence how much SDV is conducted, but whenever data is transcribed from original source into an EDC system, SDV is a relevant discussion.

EDC Data. It’s not unusual for someone to refer to data stored in EDCs as eSource. Data stored in EDCs are electronic, and may be source, but only if the EDC is the first place the data is recorded. This is what makes T/F question #2 false.

In Summary
If you’re ever in a discussion about eSource and things start going sideways, it may be time to haul out the formal definition of eSource -- in all its tedious detail -- to make sure everyone is using the term the same way. 

_____________________________________________________

Image Credit: Paradox by Brett Jordan