Short Guide To Evaluation Of Digital Work

The Journal of Digital Humanities has republished my Short Guide to Evaluation of Digital Work as part of an issue on Closing the Evaluation Gap (Vol. 1, No. 4). I first wrote the piece for my wiki and you can find the old version here. It is far more useful bundled with the other articles in this issue od JDH.

The JDH is a welcome experiment in peer-reviewed republication. One thing they do is to select content that has been published in other forms (blogs, online essays and so on) and then edit it for recombination in a thematic issue. The JDH builds on the neat Digital Humanities Now that showcases neat stuff on the web. Both are projects of the Roy Rosenzweig Center for History and New Media. The CHNM deserved credit for thinking through what we can do with the openness of the web.

Dissertation for Sale: A Cautionary Tale

The other day while browsing around looking for books to read on my iPad I noticed what looked like a dissertation for sale. I’ve been wondering how dissertations could get into e-book stores when I remembered the license that graduate students are being asked to sign these days by Theses Canada. The system here encourages students to give a license to Library and Archives Canada that includes the right,

(a) to reproduce, publish, archive, preserve, conserve, communicate to the public by telecommunication or on the Internet, loan, distribute and sell my thesis (the title of which is set forth above) worldwide, for commercial or non-commercial purposes, in microform, paper, electronic and/or any other formats;

I now just came across this cautionary story in the Chronicle for Higher Education about Dissertation for Sale: A Cautionary Tale. It seems it is also allowed in the US.

Faculty Advisory Council Memorandum on Journal Pricing § THE HARVARD LIBRARY TRANSITION

From Slashdot a story about how the Faculty Advisory Council to the Library (of Harvard) sent around a Memorandum on Journal Pricing arguing that periodical subscriptions are not sustainable and that faculty should therefore publishing in open-access journals.

The Faculty Advisory Council to the Library, representing university faculty in all schools and in consultation with the Harvard Library leadership, reached this conclusion: major periodical subscriptions, especially to electronic journals published by historically key providers, cannot be sustained: continuing these subscriptions on their current footing is financially untenable. Doing so would seriously erode collection efforts in many other areas, already compromised.

MLA Profession 2011: On the Evaluation of Digital Media as Scholarship

My paper “On the Evaluation of Digital Media as Scholarship” has just been published online in MLA: Profession 2011 (pp. 152-168). The PDF is freely available. The abstract reads,

As more and more scholarship is digital, we need to develop a culture of conversation around the evaluation of digital academic work. We have to be able to evaluate new types of research, like analytic tools and hypermedia fiction, that are difficult to review. The essay surveys common types of digital scholarly work, discusses what evaluators should ask, discusses how digital researchers can document their scholarship, and then discusses the types of conversations hires and evaluators (like chairs) should have and when they should have them. Where there is a conversation around evaluation in a department, both hires and evaluators are more likely to come to consensus as to what is appropriate digital research and how it should be documented.

This is part of a collection put together by Susan Schreibman, Laura Mandell and Stephen Olsen about Evaluating Digital Scholarship. McGann and Bethany Nowviskie, among others, also have papers in this issue of Profession.

Issuu – You Publish

Thanks to Sharla I came across Issuu a site for publishing online magazine like documents. You get an account, you upload documents, and they create an interactive page-flipping e-publication out of it. When you “Click to read” a publication an application takes over your screen to give you a reading environment. They seem to have a lot of publications made available this way.

The Shape of Things to Come — Rice University Press

Jerome McGann and Rice have published the Proceedings of The Shape of Things to Come — Rice University Press in record time. The conference took place in March and the essays are now up on line and coming out in print. (See my blog entry and conference report on the original conference.)

“Certain questions,” Jerome McGann writes in his introduction, “are especially insistent: How do we sustain the life of these digitally-organized projects; how do we effectively address their institutional obstacles and financial demands; how do we involve the greater community of students and scholars in online research and publication; how do we integrate these resources with our inherited material and paper-based depositories; how do we promote institutional collaborations to support innovative scholarship; how do we integrate online resources, which are now largely dispersed and isolated, into a connected network?”

My paper is titled As Transparent As Infrastructure. I argued that there has been a turn to infrastructure as a way to get sustained funding for things, but that don’t really know what infrastructure is and we are tempted to turn into infrastructure things that are still being negotiated.

Google Book Search Settlement

The Google Book Search Settlement, if approved by Judge Chin, may be a turning point in textual research. In principle, if the settlement goes through, then Google will release the full 7-10 million books for research (“non-consumptive”) use. Should get even the 500,000 public domain books for research we will have a historic corpus far larger than anything else. To quote the Greg Crane D-Lib article, “What can you do with a million books?” and “What effect will millions of books have on the textual disciplines?”

There is understandably a lot of concerns about the settlement especially about the ownership of orphan works. The American Library Association has a web site on the settlement, as do others. I think we need to also start talking about how to develop a research infrastructure to allow the millions of books to be used effectively. What would it look like? What could we do? Some ideas:

  • To be only usable by researchers there would have to be some sort of reasonable firewall.
  • It would be nice if it were truly multilingual/multicultural from the start. The books are, after all.
  • It would be nice if there was a mechanism for researchers to correct the OCRed text where they see typos. Why couldn’t we clean up the plain text together.
  • It would be nice if there was an open architecture search engine scaled to handle the collection and usable by research tools.

Update: Matt pointed me to an article in the Wall Street Journal on Tech’s Bigs Put Google’s Books Deal In Crosshairs.

Clay Shirky: Newspapers and Thinking the Unthinkable

Thanks to Peter O I came across Clay Shirky’s excellent analysis of what’s going on with newspapers and the web, Newspapers and Thinking the Unthinkable . Some of the salient points:

  • Change has been so rapid that it has changed who is pragmatic and who is a fabulist. Newspapers are in denial about the realities of online content so those who describe what is happening (the pragmatists) are treated as fabulists.

Revolutions create a curious inversion of perception. In ordinary times, people who do no more than describe the world around them are seen as pragmatists, while those who imagine fabulous alternative futures are viewed as radicals. The last couple of decades haven’t been ordinary, however. Inside the papers, the pragmatists were the ones simply looking out the window and noticing that the real world was increasingly resembling the unthinkable scenario. These people were treated as if they were barking mad. Meanwhile the people spinning visions of popular walled gardens and enthusiastic micropayment adoption, visions unsupported by reality, were regarded not as charlatans but saviors.

When reality is labeled unthinkable, it creates a kind of sickness in an industry.

  • The economics of publishing have changed. It used to be that there was a tremendous upfront cost to set up a newspaper or broadcasting facility. Now the infrastructure of distribution is paid for by all so publishing is cheap.

With the old economics destroyed, organizational forms perfected for industrial production have to be replaced with structures optimized for digital data. It makes increasingly less sense even to talk about a publishing industry, because the core problem publishing solves — the incredible difficulty, complexity, and expense of making something available to the public — has stopped being a problem.

  • It is easy to describe life before or after an epochal shift. It is hard to describe the chaos of experiments during the shift. Shirky looks to The Printing Press as an Agent of Change as an example of the hard type of history.

What Eisenstein focused on, though, was how many historians ignored the transition from one era to the other. To describe the world before or after the spread of print was child’s play; those dates were safely distanced from upheaval. But what was happening in 1500? The hard question Eisenstein’s book asks is “How did we get from the world before the printing press to the world after it? What was the revolution itself like?”

  • Advertisers don’t want to pay for the costs of a full-featured newspaper (with international bureaus and investigative reporting.) They will move their money to where it connects with their (usually local) audience.

The competition-deflecting effects of printing cost got destroyed by the internet, where everyone pays for the infrastructure, and then everyone gets to use it. And when Wal-Mart, and the local Maytag dealer, and the law firm hiring a secretary, and that kid down the block selling his bike, were all able to use that infrastructure to get out of their old relationship with the publisher, they did. They’d never really signed up to fund the Baghdad bureau anyway.

  • Newspaper reporting provides a public service that will be missed, but knowing we will miss it doesn’t save it. We just don’t know how to fill the gap that will be left when daily papers dissappear in cities.

“You’re gonna miss us when we’re gone!” has never been much of a business model. So who covers all that news if some significant fraction of the currently employed newspaper people lose their jobs?

I don’t know. Nobody knows. We’re collectively living through 1500, when it’s easier to see what’s broken than what will replace it.

Actually I think there are ideas floating around as to what might fill the gap:

  • Blogs may take up some of the slack with various advocacy groups and NGOs providing investigative reporting in the areas that concern them. I think it is wrong to assume that amateurs will necessarily do a worse job than professional reporters. In fact, as most know, professionals are too busy to usually go into depth and whenever they write about something you know they get it wrong in all sorts of ways. A blog like Buckets of Grewal probably does a more indepth job of examining the Grewal controversy than any newspaper story. The difference is rather that the professionals are committed to breadth and they write better.
  • Publicly funded broadcasters like the BBC and the CBC will provide tax funded news reporting with foreign bureaus and so on. They don’t have to have make a profit and can invest in things perceived as useful for society.
  • There will always be some big and international newspapers like the New York Times or Reuters because there will always be a demand for that sort of news. The internet reduces diversity – every city doesn’t need a newspaper with a foreign bureau. All we need is a couple of news services with foreign bureaus.
  • Some companies have already figured out how to package news as analysis and get other businesses to pay for it. This will accelerate as newspapers fail. Companies like Oxford Analytica will meet the demand of multinational businesses who need access to strategic information. The sooner the newspapers fail the sooner we will see these companies come out of the woodwork and start selling their products to us.

To conclude with another quote from the Shirky essay, “Society doesn’t need newspapers. What we need is journalism.”

MIT: Open Access Mandate

From Twitter I found a link to Peter Suber, Open Access News where there is a story of MIT’s unanimous faculty vote to adopt an Open Access mandate that gives the University the right to archive and make available their articles. Like the Harvard mandate, faculty can opt out if they have a good reason.

Each Faculty member grants to the Massachusetts Institute of Technology nonexclusive permission to make available his or her scholarly articles and to exercise the copyright in those articles for the purpose of open dissemination.

Gary Hall: Digitize this book

A couple of weeks ago I posted a blog entry about Gary Hall’s book Digitize This Book! I noted that I couldn’t find a digitized copy of the book and asked if others knew of one. To my surprise Gary wrote me back and pointed to the items listed below. Now that is the Internet at work! He is trying to get the publisher to allow a digital copy to be posted online, but in the meantime pointed out online versions of what became chapters in the book:

(2003) ‘Digitise This’, Mediactive, Vol. 1, No. 1 (pp. 76-90); republished in (2004), The Review of Education, Pedagogy and Cultural Studies, Vol. 26, No. 1, January-March (pp. 23-46) at (MS Word Document)

(2007) ‘IT, Again: or, How to Build an Ethical Virtual Institution’, in Experimenting: Essays With Samuel Weber, edited by Gary Hall and Simon Morgan Wortham (Fordham University Press: New York) (pp.116-140) at (MS Word Document)

Gary Hall says that “Since the book came out I’ve also published a new piece on open access publishing and the humanities” at A video of him presenting it as a talk is available at Pirate Philosophy – Steal This! .

I take back any irony in my previous post. (Can one take back irony? Perhaps I can only apologize for being ironic to early.)