Archive for July, 2010

UCLA survey of knowledge about the NIH Public Access Policy

Measuring Capacity and Effectiveness of NIH Public Access Policy Programming as a Model for Open Access by Tania Bardyn and 4 co-authors, UCLA Louis M Darling Biomedical Library. Dated July 24, 2010 in the University of New Mexico DSpace repository.

Abstract: This file contains the presentation slides from Ms. Bardyn’s presentation at the Evidence Based Scholarly Communication Conference, March 11-12, 2010, in Albuquerque, NM. [PDF of 44 presentation slides].

This was a “Survey of Translational and Other Researchers’ Knowledge of the NIH Public Access Policy at UCLA“.

  • From Slides 3, 9 & 10: Translational researchers at UCLA (N=?) and attendees at 8 NIH Workshops (N=103) were surveyed. The survey took place between Nov. 30, 2009 and Dec. 15, 2009.
  • From Slide 13: 72.5% of responses (50/69) were from the David Geffen School of Medicine.
  • From Slides 15 & 17: Of 69 respondents, 51% did not attend an NIH Workshop at UCLA. And, 51% were Translational Researchers.
  • From Slide 16: 74% (51/69 respondents) answered “Yes” to the question: “Are you currently involved in any NIH funded research?
  • From Slide 26: 50% (32/64 respondents) did not know the stated intention of the NIH Public Access Policy.
  • From Slide 36: Of 65 respondents, 43% had successfully submitted an article to PubMed Central.
  • From Slide 37: Of 65 respondents, 95.4% answered “No” to the question; “Have you made any attempts to retain your copyrights when publishing in an academic journal?“.
  • From Slide 38: Knowledge Sharing: 89% (24 respondents) of NIH Workshop Attendees answered “Yes“; 49% (17 respondents) of Translational Researchers answered “Yes“.
  • From Slide 42: Quote from survey respondent at UCLA, December 2009 (about future training on the NIH Public Access Policy): “I think it is more efficient for the NIH website or other external website to provide such training. The issues are the same at all universities and it is not clear why each institution should provide this information. Since the NIH requires IDs on papers in biosketches and progress reports, that affects investigators competitiveness on grants which is much stronger motivation to comply with the policy than mandated training by UCLA which will force investigators to know the policy, but not necessarily comply with the policy.”
  • From Slide 43: 57% (37/65 respondents) answered “Yes” to the question: “Do you think you need further training on this issue?“.

Comments: The response rate was not high for this survey. Of 103 NIH Workshop Attendees, only 43% of 69 survey respondents were sure that they had attended a Workshop. So, the response rate from NIH Workshop attendees was 0.43×69/103=29%. It’s not stated how many Translational Researchers were surveyed, but it’s unlikely that the response rate for the Translational Researchers was higher than it was for the NIH Workshop Attendees.

Might the survey results be biased in a way that yielded an underestimate of knowledge about the NIH Public Access Policy by translational and other researchers at UCLA? This also seems unlikely.

A question that wasn’t answered in the slide presentation: were the 28 respondents who had successfully submitted an article to PubMed Central (see Slide 36/44) also the most knowledgeable about the NIH Public Access Policy? (If not, does it matter?).

Comments (1)

Finding influential OATP news items

The Open Access Tracking Project (OATP) provides a unique resource. It distributes information about recent news items of interest from the perspective of the Open Access movement. Participants in the OATP tag new developments using Connotea. The OATP links include project feeds that contain all (and only) the items that participants have tagged with oa.new. One of the feeds is a Twitter feed, based on the version of the Connotea RSS feed showing the 50 most recent items.

Some influential news items are bookmarked in Connotea by more than one participant. One of the useful OATP mashups is a filtered version of the project feed, a “OATP 100 items no dups” feed of the 100 most recent news items, without duplicates.

Influential news items are also often found in multiple tweets, or have been retweeted, via Twitter. Another useful resource is Topsy, a “search engine powered by tweets“. Topsy provides way to assess the influence of news items that have been included in the OATP Twitter feed. One can simply use Topsy’s Advanced Search option to search within the Twitter user OATP. Such searches within the OATP Twitter feed can be restricted to the current day, or week, or month. The number of duplicate tweets (or retweets) about a news item can be used as a quantitative indicator of the influence of a particular news item. (It’s the URL of the news item that counts, not the exact text of the tweet). This indicator provides one kind of “article-level metric” (ALM) for that news item. (For an informative commentary about ALMs, see the OA article: Article-Level Metrics and the Evolution of Scientific Impact by Cameron Neylon and Shirley Wu, PLoS Biol 2009(Nov); 7(11): e1000242. [PubMed citation]).

An example of a very influential news item (well over 900 tweets, including the one from the OATP) during the week ending on July 24, 2010 was: BP buys up Gulf scientists for legal defense, roiling academic community | al.com. (See all of the Twitter trackbacks for this news item, via Topsy). The Connotea bookmark for this news item was tagged oa.industry, oa.new, oa.negative, oa.data by Peter Suber (Connotea user “petersuber“).

Comments:

Efforts to keep up with recent news items involve three major aspects. Firstly, there must be ways for the news items to be discovered. Secondly, ways are needed to filter the discovered items so that those of particular interest to an individual user can be identified easily. Thirdly, the discovered items of interest must be accessible to the reader.

About discovery: The Open Access movement may be unique, from a scholarly perspective, in the extent to which credible items of interest are distributed across the entire Web. A wide variety of online sources provide relevant items. The participants in the OATP (especially, Peter Suber) have been extraordinarily diligent in their efforts to discover such items. Additional news items can be identified via these tags: #openaccess and #oa. There is much overlap between these latter results, because both of these hashtags are often used together. I’ve not yet found an easy way to assess the extent of overlap between news items identified by the #openaccess or #oa hashtags and those included in the OATP feeds. There’s a feed that combines the OATP results with those for #openaccess, but duplicates between the two have not been eliminated.

About filtering: The tags added to Connotea bookmarks can be used to filter news items obtained via the Connotea site. An example is provided by the results of a search for oa.canada. Unfortunately, the Connotea search engine tends to function slowly, especially when combinations of tags are sought.  Searches via Topsy are more convenient, but Topsy does not recognize “oa.new” or “oa.canada” as hashtags, in the absence of a “#” symbol. My own experience so far has been that, thanks to the OATP, there’s less of a discovery deficit when seeking OA-related news items, and more of a filtration challenge. What are the most efficient ways to find those news items of greatest personal interest? They may not always be items that have a noteworthy number of Twitter trackbacks.

About access: there’s an advantage to the fact that credible news items of interest to the OA movement are widely distributed across the entire Web. Unlike articles in traditional toll-access academic journals, OA-related news items tend (not a surprise) to be publicly accessible, usually via Gratis OA. Perhaps the OA movement is in the process of providing an initial test of the conjecture that we are in the early stages of a growing movement to abandon traditional academic publishing? Or, perhaps more realistically, in the early stages of a growing movement to supplement traditional academic publishing with a variety of other approaches, all based on free and open services?

Leave a Comment

OA news update 2010-07-15

For links to recent news items about OA, visit the Topsy search pages for [“oa.new”] and [#openaccess] and [“open access”].

An example of a news item that has received attention in the past week: Global open access slowly growing, study finds – SciDev.Net. http://bit.ly/9KyHRG (via @oatp). Hashtag: #openaccess. Posted to Twitter on Tue Jul 13 via TweetDeck.

Leave a Comment

Heart and Stroke Foundation of Canada’s OA policy

HSF Open access to research outputs policy: Guidelines, Heart and Stroke Foundation of Canada. Last updated: June 29, 2010. [FriendFeed entry]. Excerpts:

The Heart and Stroke Foundation of Canada’s (HSF’s) mission is to lead in eliminating heart disease and stroke and reducing their impact through the advancement of research and its application, the promotion of healthy living, and advocacy. To that end, HSF is committed to enhancing the application of research results. By adopting this policy, HSF expects that the cutting edge research we fund will be freely accessible and useable for the international research community, policymakers, health care administrators, clinicians, and the public.

…..

This policy applies to all publications which report work and findings obtained with the support, in whole or in part, of any type of grant awarded June 1 2010 and onward from the Heart and Stroke Foundation (HSF). HSF also encourages immediate compliance with this policy by researchers publishing work supported by HSF grants received before June 1 2010.

HSF recognizes that there may be reasonable limitations and exceptions to compliance. However, researchers are expected to make every effort to comply and must notify HSF staff immediately when there are exceptions or limitations.

…..

HSF covers expenses that researchers reasonably may incur related to publishing in Open Access or hybrid scholarly journals.

Leave a Comment