Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts

Thursday, June 27, 2019

New From Academe--The Magazione of the AAUP; Academic Freedom and Free Speech



I am happy to pass along the table of contents of the features in the latest issue of Academe--the Journal of the American Association of University Professors. 

FEATURES
Knowledge for the Common Good
A plenary presentation from the AAUP’s 2019 annual conference.
By Joan W. Scott
Political Interference with Academic Freedom and Free Speech at Public Universities
The threat of governmental suppression of academic inquiry.By Gene Nichol
Rebuilding "Iowa Nice" in Shared Governance: From Sanction to Collaboration
A faculty senate committee works to address governance concerns.
By Sandra Daack-Hirsch, Frank Durham, Russell Ganim, Edward Gillan, and Justine Kolker

Of particular interestare the remarks of Jopan Scott, which are reproduced below.  Joan W. Scott is professor emerita in the School of Social Science at the Institute for Advanced Study in Princeton, New Jersey. She is a long-standing member and former chair of the AAUP’s Committee A on Academic Freedom and Tenure.


Tuesday, July 24, 2018

Assessment and Learning Outcomes Comes to Law Schools: Some Recent Scholarship

(Pix Nebamun viewing his geese and cattle; British Museum, 2018)


We live in a word of accountability, whose laws are implemented not through the coercive police power of the state but rather by the constant and repetitive process of assessment. That assessment, in turn, constitutes a data driven self reflexive system that both monitors and imposes orthodoxy through the choices made with respect to those data and that analytics on which judgment is rendered and consequences felt.

Faculty have assumed an interesting place within these cultures of monitoring and data driven assessment. In one respect the metrics used for assessment have consequences for their own evaluation; simultaneously, these metrics are at the center of emerging cultures of the assessment of faculty handiwork--the effect of their interactions with students. What could be more neutral than data driven analytics--especially ones whose parameters are chosen by those on whom they are imposed.  Assuming, of course, that there is real choice. And that, increasingly, may not be the case as regulators--whether public or private, increasingly use their authority to constrain and manage choices that can be made respecting the scope of assessment, its objectives and the objects of its analytics. that changes not merely the focus of the assessment-accountability exercise, the its purpose as well.
 
Whatever one thinks of these new approaches to accountability of the role of faculty to disseminate of knowledge to students; it has produced at least one benefit--the expansion of knowledge production to include assessment itself. This is especially the case in the context of legal education. The Winter 2018 issue of the Journal of Legal Education (JLE) takes an in-depth look at the revised ABA standards on assessment and learning outcomes. Links to the articles follow. Each is worth considering carefully.

Wednesday, November 8, 2017

The Opaque Academic Unit--Little Practices that Undermine Faculty Participation in Managing their Own Academic Programs--the Strategic Use of Room Assignments

(Pix © Larry Catá Backer 2017)


I have been writing about the larger issues that are shaping the relationships between faculty and administration at the university.  I have noted that these changes reflect larger fundamental changes about the nature of the university and its role in society, as well as respecting the nature and character of the role in education of individuals that produce knowledge (research) and that disseminate it (teaching). In that context I have suggested the way that administration and faculty have become culturally and socially distinct classes within the university; that each of these classes no longer relates to each other as connected by any shared values or mission; and the way that both have increasingly turned inward for the construction of their values, their approach to relations with "others" and with respect to their socialization within their respective communities. 

The consequences of these transformative changes affect all aspects of university operations. Among the most important of these consequences for faculty are those that contribute to the relentless and systematic de-profesisonalization of faculty's role in the university.  It is already accepted that de-professionalization has effectively expelled faculty from meaningful engagement in the operation of the institution of the university, responsibilities that were long ago ceded in whole or in part  to (mostly non-academic) administrators, who tend "the the institutional machine."

Though I spend a lot of time considering the broad stroke activities of administrations as they seek to change the university, the great changes to the university are not usually brought about through grand gestures. It is in the little actions, the ministerial details, the small rules that, in the aggregate, the largest and most profound changes are insinuated within the institution. Starting with this post form time to time I will highlight briefly emerging practices that effectively erode faculty engagement in their own work and turn them from active partners to passive receptacles.

One emerging practice is worthy of note: Strategic Room assignments. Administrative officials usually are delegated the task of room assignments. At one level this task appears entirely ministerial. Yet consider again what happens when faculty are excluded form any  involvement, or when the process of room assignments can be used to usurp faculty involvement in academic programs.  When used strategically or carelessly, room assignment practices can effectively function like enrollment limits--without the need to ask faculty whether they desire an enrollment limit, and if so what might be their target number.  Indeed, no conversation need to had. Its strategic use is revealed when faculty seek to change rooms to accommodate larger enrollments and are effectively stonewalled by officials. Efficiency and administrative convenience in this instance can override any need to align room allocations with needs. More interesting is that it hijacks the possibility of any academic discussion about programs and what enrollment figures suggest by converting the issue into a mere administrative puzzle.  This transformation of issues that have significant academic components into ministerial tasks effectively strips faculty of any involvement in program assessment and limits the ability of faculty to affirmatively control their class sizes. What makes this practice effective is when it is combined with other little practices that involve exercises of administrative discretion. An example: the faculty member that complains about the use of room assignments to shrink her class may get a room change (or not), but might also find herself assigned to very early morning or very late afternoon (Friday) classes for a few semester thereafter.  Causation will be impossible to prove and justification pre-manufactured strong enough to survive internal grievance mechanisms (because of the increasingly broad scope of discretion allocated even to lower level officials).

If you have knowledge or experience with additional practices please pass them on and I will post anonymously.

Friday, August 18, 2017

Efficacy Studies and the Education Sector


 In "A Primer on Effectiveness and Efficacy Trials" (Clinical and Translational Gastroenterology (2014) 5), Amit G Singal MD, MS, Peter D R Higgins MD, PhD and Akbar K Waljee MD, MS, explain:
Intervention studies can be placed on a continuum, with a progression from efficacy trials to effectiveness trials. Efficacy can be defined as the performance of an intervention under ideal and controlled circumstances, whereas effectiveness refers to its performance under ‘real-world’ conditions.1 However, the distinction between the two types of trial is a continuum rather than a dichotomy, as it is likely impossible to perform a pure efficacy study or pure effectiveness study. (source, see also here)
This method  appears to be on the horizon of those who influence the cultures of the education industry (here, here, here, and here). 

Goldie Blumenstyk has recently reported for the Chronicle of Higher Education about the release of papers from a first of its kind symposium on efficacy research hosted by the University of Virginia:

1. Colleges spend upward of $5 billion a year on educational-technology products, but often they lack data that could better inform the decisions they make on what to buy. Over the past year, several dozen academics, business executives, and policy wonks researched why “efficacy research” isn’t more of a factor in these decisions. Some of those findings were presented at a symposium in May, and now the full reports are available.

2. Efficacy research isn’t just missing in ed tech. It’s also all-too-absent when it comes to the burgeoning world of “alternative” educational credentials, at least according to a new report by Ithaka S+R, a nonprofit consulting organization, for the American Academy of Arts & Sciences. Among other recommendations to policy makers, funders, and the higher-education community, the report recommends broadening quality-assurance processes so they can include educational programs not offered through traditional colleges as well as an investment in “a more comprehensive data system that captures longitudinal, student-record data on students’ experiences across the full array of postsecondary pathways, as well as information about providers and their programs and credentials.” In a world where some advocates are still pushing for more complete data on students in traditional higher-education settings, that could be a big ask. Or perhaps it will become one more argument in their favor. —

The links to the reports produced from the symposium and the press release follow. 

Saturday, August 12, 2017

From the Journal of Legal Education: Legal Academics Speak to Sexual Harassment, Academic Policies and Title IX


(Pix © Larry Catá Backer 2017)

In 2016, Georgetown Law, The Journal of Legal Education and the Georgetown Gender Justice Project hosted a conference on the subject of Sexual Assault and Academic Freedom on College Campuses. The Press Release Conference Note explained the scope of the Conference:
Universities occupy a hallowed position in American culture. But numerous studies showing high rates of sexual assault on college campuses, as well as several well-publicized incidents, have spurred not only a wave of concern about students' safety but also new and more rigorous policies for addressing these assaults in universities and colleges across the country. While the importance of protecting students from violence is unquestioned, these new policies call for consideration of issues such as the appropriate role of administrative decision-making, the role of governmental regulations, the need for academic freedom, and the rule of law generally. How can we best ensure an educational environment free from sexual violence but, at the same time, provide for academic freedom and fair processes? How might we best maintain academic freedom without making it a defensive shield against enforcing equal opportunity requirements within academic life? These and related questions will inform the symposium.
The Journal of Legal Education has now published articles from that conference in its Summer 2017 issue.  The articles, with links, follow.  The articles merit serious study and discussion:


Sunday, July 9, 2017

Valuing Labor in the Academy--Considering the Problem of Pricing the Production of Faculty and Administrative Outputs in the University and the Suggestion of an Alternative Approach

(Pix © Larry Catá Backer 2017)


The Chronicle of Higher Education recently published an article in which it described some ranges of compensation for the top executive officers of public universities (Dan Bauman, Executive Compensation at Public Colleges Rises by 5%, With Texas Leading the Way, Chronicle of Higher Education 27 June 2017).  To no one's surprise, the news was big. . . bigger . . . and more! Beyond the presidents of two Texas universities compensated in excess of $1 Million, the article noted 
The average pay of public-college leaders, including those who served partial years, was roughly $464,000 in 2016. Among presidents who served the whole year, average pay was slightly more than $521,000. Leaders who served full years at institutions surveyed in both 2015 and 2016 saw a pay increase of 5.2 percent. (Dan Bauman, Executive Compensation at Public Colleges Rises by 5%, With Texas Leading the Way,supra). 
Most of these stories--along with stories of high pay for "star" academics and less for everyone else is justified either because of the inescapable workings of wage labor markets or because of the unique characteristics of the job or the person filling it.

Yet all of these methods--and the focus of pay generally, tends to focus on the individual.  Indeed, the personality of labor appears always to be bound up in the individual.  That is quite distinct from other forms of factors in the production of university wealth.  For other input factors, the general tendency is to understand them as a function of productive force--that is the relative cost of the factor relative to the quantity and quality of the production to which it contributes.

This post considers the problem of the valuation of labor in the university and suggests a possible approach to a usable measure of the value of labor production that makes it easier to treat together the productive value of administrative and faculty production.


Monday, March 6, 2017

How Not to be a Dean--A Set of Perverse Lessons


Academic middle managers increasingly find themselves in a bind.  On the one hand they, unlike more senior administrators, tend to be drawn from the ranks of faculty (though nor necessarily of the faculty over which they have been given dominion) and have been socialized  deeply in academic faculty centered cultures.  On the other hand, the emerging cultures of administration--autonomous of and quite distinct from that of faculty centered cultures--require the cultivation of sensibilities that draw middle managers into an increasingly adversarial relationship with the factors in the production of unit wealth that faculty represent.  

Most successful middle managers navigate this contradiction in time honored fashion.  They develop a rhetorics of solidarity with their staff while at the same time embrace the cultures of administration and its quite distinct approach to the management of the production of students through a transnational  web of knowledge dissemination and production.  However, as the cultures of administration and those of faculty increasingly diverge, and as faculty itself begins to fracture along worker class lines (tenured and nontenured full time staff, fixed term faculty, research or teaching faculty, adjuncts and graduate assistants) the natural solidarity of middle managers toward their colleagues will dissipate as well. 

In that context, it may be necessary to begin to think about the ways that this fissure between deans and faculties now shows up in managerial techniques.  This post considers some of the most interesting and telling examples of the perhaps inevitable break between faculty and those charged with their oversight.It is put together as  a set of lessons for the young manager on the emerging rules of managing faculty , the effects of which are likely to be the opposite of what is intended. 

Let folly reign!

Sunday, February 12, 2017

What is the University?: De-Centering Education in an Age of Risk and Regulatory Management


(Pix © Larry Catá Backer 2017)


People constantly ask variations of the question--What is the University? --usually as a rhetorical throat clearing to put forward some sort of ideological position that advances a particular agenda in the service of quite specific objectives.  That is to be expected, of course. But it is not the subject of this post.

Rather, the more interesting answer to this question ought to start with a more fundamental set of questions: (1) what are the objectives of regulatory society? and (2) how has the university changed to resemble and amplify greater society.  Asked in this way, the answer becomes much more interesting than the ideology-by-other-means discussion that tends to put off everyone but their advocates. 

The answer to these questions might be gleaned by the resources that universities increasingly devote--not to knowledge production and dissemination--but to the regulatory control of their stakeholder populations (students, faculty, staff and others that affect the university and its operations) either  for its own account or as a pass through institution administering privatizing regulatory demands of superior public institutions (usually state and federal governments). A recent communication from the President of Penn State University perhaps nicely illustrates the trend--not because it stands out but for precisely the opposite reason, for the way in which it reflects standard practice among universities, for the way it applies consensus within higher education about the regulatory role of the university. Indeed one might expect this to serve as a standard generic letter of its kind issued in some variation by many similarly situated high officials. It is for that reason that the communication is most interesting.

This post considers the larger societal consequences of the changes suggested, as a general matter and in common with other universities, by that communication.  The object is neither to condemn or praise the tend--but rather to notice them and consider what they might say about the character and function of the university generally in early 21st century America. The communication is reproduced below and is followed by some brief thoughts.

Friday, January 20, 2017

An Open Letter to a Hypothetical Vice President of Compliance--Faculty Productivity, Shadow Work and Policy Coherence in the Regulatory University

(Pix ©Larry Catá Backer 2017)


I have been speaking to issues of shadow work and the changing nature of expectations of faculty (e.g., here). I have suggested that ways that this affects faculty productivity by shifting focus form teaching, research and service to compliance and compliance related activities. This shifting can have a net zero effect only when faculty are implicitly asked to dig further into their private lives time to satisfy the increasing cravings of administrative bureaucracies within government and their mirror images within the university. At its limit, the growing movement toward compliance cultures without reducing teaching, service and research expectations creates both a burden and en effective and substantial reduction in the compensation of university personnel per hour of work extracted. That is hardly fair, though it may be legal. And ironically it may as well violate the ethics codes universities have been at pains to impose on faculties these last several years.

The movement toward compliance cultures is not malicious. It is a product a deep cultural changes that have created strong incentives to privatize public policy respecting cultural changes. And it expresses a strong change in social and political consensus respecting the role of the state (and institutions to which state policy objectives have been delegated) in using regulation, reporting and compliance as the means for managing and changing behaviors among the U.S. population. As a consequence, social behaviors are now constrained by a web of federal and state law, administrative regulations and university policy, and much of what constitutes compliance reflects discretionary administrative choices respecting the implementation of these webs of regulatory mandates.

This has strong implications for shared governance as well as the participation in the development and control of faculty productivity. The administrative regulations that tend to emerge from, through or in conjunction with  the compliance offices of universities tend to ooze out in ad hoc fashion and they tend to be justified in vague references to the need to comply with "applicable law or university policy". By that standard and in that process, there is no possibility of accountability and the scope of administrative discretion to justify anything by reference to their "right" to "interpret" value and unspecified standards has no constraint.  That is bad management for shared governance, but is is worse management for a university provost that has no ability to well manage her administrative units in an intelligent way.  

The first step toward coherent and constraint in compliance is  information.  This post includes an open letter that may be sent to an appropriate compliance officer with the purpose of gathering the sort of basic information necessary to begin a discussion about compliance in an intelligent way--both with respect to discretionary choices made and with respect to the consequences of compliance as faculty shadow work. The open letter follows.  Feel free to send to your own compliance office and report back on results. 

Thursday, January 19, 2017

Moving Beyond University Expropriation and Control of Faculty "Outside Business Activities" --a Proposal for a Rule that is Simple and Fair

(Pix © Larry Catá Backer 2016)


In Just Because it is Legal Doesn't Make it Right--The Extension of University Control of Employee "Outside Business Activity"  I considered the way that the most pernicious aspects of the master-servant relationship tolerated in U.S. law has been creeping into the relationship between the university and its faculty.  That creeping  has been embedded in increasingly exploitative "conflict of commitment" and "Management of Teaching Services" rules that universities have begun to use as a means of controlling the productive capacity of its employees even beyond the scope of their contract periods. Three distinct aspects were noted: (1) Many research 1 universities have begun to seek to claim for themselves not just the fruits of the labor they paid for in hiring staff, but also to control and exploit all faculty productive capacity even beyond contract term periods.  (2) At the same time, the university has begun to see in their faculty an extension of their brand--the objectification of the human being who serve as faculty..in a way that reduces them to factors in the production of university reputation ONLY, and thus amenable to control by the university at all times as if they were other sorts of property. (3) Lastly, the university sees in the aggregated work activities of faculty an enormous  source of data that could be better exploited and thus view  rules regulation work beyond that compensated through university contracts as a valuable information asset to be harvested. 

These trends have not occurred in a vacuum. There is no disputing that individuals have taken advantage of the porous nature of the teaching-university relationship. These include multiple simultaneous full time teaching producing, in the most egregious cases multiple simultaneous tenured appointments. Outside consulting during the academic year can become so excessive that it interferes with compensated expectations for research, teaching and service. Outside activity might conflict with the interests of the university directly (I take as more hysterical, strategic, and overblown university efforts to create prophylactic rules that extend conflict beyond direct and substantial conflicts between faculty activity and university interests).

It has been in that context that universities have sought to protect their legitimate interests--and investment--in their faculty. And usually that has produced badly drafted and overblown regulatory efforts, usually drafted by lawyers or administrators with little experience regulatory drafting but enthusiastic to extend university authority to the full reach of the law. The result has been characterized by overreaching that at times might suggest that the now popular university ethics rules do not apply to its own regulatory activities. Worse, these regulatory efforts tend to become complex baroque affairs to collapse into incoherence by weight of their own overwrought cleverness--none of which provides real substantive benefit to the university. Compare typical variations on the conflict of interest, conflict of commitment and outside teaching and consulting policies: University of Georgia; University of Washington; University of Texas; University of Utah; University of Maryland; and Purdue University.

That is regrettable. But fairly easy to fix IF (the university is willing to take a reasonable position and faculty are willing to engage in outside activities judiciously and in good faith. To that end a simple rule that is easy to understand and easy to implement, a rule that is easy to monitor and apply might be the most useful mechanism to balance the interests of university and faculty- That simple rule ought to be respectful of the faculty's right to employ his own productive forces when he is not rendering service to the university, while protecting the university in its legitimate expectation that its employees will not shirk. The easiest approach is to provide a simple safe harbor rule for faculty consulting and teaching outside the university, one that is entirely focused on those time periods when the faculty member is employed by the university (usually under a 9 month contract), but relinquishes control when the university does not pay its faculty for services. At the same time, such a simple rule ought to be generous in permitting the university to harvest data about such activity--to the extent that such data is shared with those contributing information.

I have produced a model that is geared for Penn State but is easily applicable to other major research universities.  It follows.  Comments and reactions welcome.  For a variation See Michigan State University.  For an alternative consider Harvard's Statement.


Saturday, June 11, 2016

Challenging the Ordering of Markets for Academic Prestige: On the Business of Academic Conferences, Status Hierarchies and the Markets for Knowledge Production and Dissemination

(Pix (c) Larry Catá Backer 2013)

I have written before on the ways in which markets for academic prestige, and for sorting academics within informal "ranks", have become routinized and institutionalized over the last 30 or so years in their current form. In Ordering Markets for Academic Knowledge Goes Global: Pablo Lerner on "Foreign Influences and 'Law Reviews Rankings' in Israeli Legal Scholarship "I suggested methodologies for knowledge production valuation within institutions that sought to capture some of the intrinsic value of the thing produced, even when measured extrinsically.  The problem, of course, is the nature of the market for knowledge.
The production of knowledge, especially among academics, is not simply offered for consumption.  Like all consumables, it is judged and valued in the market within which it is offered.  And again, like other consumables, the judging of academic knowledge products has become standardized, and its assessment routinized in ways that  both make it easier to understand what one is buying and also makes it more likely that all products will resemble each other. 
One of the principle external consequences of this market for academic production, is that much of what is produced is predictably the same--and the market likes it that way.  Another is that producers are judged  (tenure and promotion) by their fidelity to the packaging (law review articles and books) and content standardization (its fidelity to the generally shared normative presumptions of the leading practitioners in the field) features of  knowledge commodities.  To that end, assessment structures are required not merely for the academic, but also for the secondary structures within which her status is itself assessed. (Cf. Backer, Larry Catá, Global Panopticism: States, Corporations and the Governance Effects of Monitoring Regimes. Indiana Journal of Global Legal Studies, Vol. 15, 2007).
Along with others, I have suggested the consequences of rmeasurement--and asessment--within systems  constructed specifically to permit a continuous and self reinforcing system of hierarchy and protecting the privileges of "leading" groups within disciplines ("Defining, Measuring and Judging Scholarly Productivity: Working Toward a Rigorous and Flexible Approach," 52(3) Journal of Legal Education 52(3):317-341 (2002) (examining, in part, the way that discussion od scholaraship and its produciton is skewed by other issues, principally the objectification of scholarship goals)).

Two items suggest that what appeared to be a stable environment for such markets may be coming to an end. One, in English from Duncan Green appearing on an LSE Blog,  Conference rage: How did something as truly awful as panel discussions become the default format? touches on the organization and hierarchies of the performances through which knowledge is disseminated to the academic community. . .and others. The second, in Spanish, an open letter from Roberto Breña, El Colegio de México, is in the form of an open letter to the leadership of the Latin American Studies Association on the deficiencies of the structures of contemporary conferences for academics in a recognized "field" of study. Part of both follow along with my brief comments.

Saturday, April 16, 2016

Diversity at Penn State: Reports of the Joint Diversity Awareness Task Force--Moving Forward Embedding Divesity Policy--Advisory/Consultative Report




(Pix © Larry Catá Backer 2016)

It has been my great honor to serve as the Chair of the Penn State University Joint Diversity Awareness Task Force (JDATF). JDATF was charged this past April by our Provost and the University Faculty Senate Chair to consider a number of important diversity initiatives at Penn State (Charge (PDF); Members). Our work over the academic year has produced four reports with recommendations for substantial changes in a number of areas.

Presented March 2016 for consideration by the PSU Faculty Senate April 2016:
1. US/IL Courses Survey--Recommendations (Legislative; and Advisory/Consultative)
2. Diversity Best Practices
3. Moving Forward Embedding Diversity Policy

Presented February 2016 and Approved by the PSU Faculty Senate March 2016
4. Moving Forward
Each of the next several posts will provide links and the text of the reports to be considered by the Penn State Faculty Senate on April 19. An "after action" report will follow Senate action on the 29th--action which I hope will be positive.

This post includes the Report, Moving Forward Embedding Diversity Policy, which was prepared by our Substantive Policy Recommendation  Sub-Committee.


Tuesday, January 12, 2016

Part 1 Penn State Law: The Public Face of Diversity--The Example of Penn State

(Pix © Larry Catá Backer 2016)

Diversity has become an important element of operations at the American University.  It has become a priority for governance at most research universities.

At Penn State diversity has been embedded at the core of the strategic planning of the university on both pragmatic (demographics) and normative (morals) grounds. Among the challenges identified by Penn State in its project of enhancing diversity touches on communication--both to stakeholders nd the wider community (see, e.g., here). is  This post and those that follow will consider the public face of Penn State's diversity efforts.  It will look at the way that Penn State's units have embedded diversity in their communications by looking at diversity on the web sites of Penn State's units.  The purpose is simple--the way a university projects itself provides a good means of understanding how the university sees itself.  In light of the President's commitment, it would be useful to examine the way that diversity appears throughout Penn State.  This post provides a short introduction to the character of that public face from the top of the administrative hierarchy.  In the posts that follow, we will consider how each of Penn State's units projects its own image of its engagement with diversity in light of official and public face of diversity at Penn State.

The object is not just to get a sense of the collective self projection of this important issue an an important an influential university.  It also serves to see the extent to which diversity can be administered in a coherent manner throughout a large and complex institution.  Do all units approach the issue the same way? Do all units share the same approaches to diversity as the central administration suggests they should?  What are the variations in approaches?  These and other related questions will be posed and considered.  Comments, suggestions, and additional insights are welcome as we work through the theory and practice of diversity at major institutions.

This post starts with Penn State Law.

The Table of Contents may be accessed HERE.

Monday, September 7, 2015

The Power of Assessment and the Production of Knowledge: An Example and a Warning for Faculty Complacent About the Mechanics of Value





(Pix © Larry Catá Backer 2015)


I have been speaking to the issue of assessment--not so much as a set of techniques designed to extract data that can be evaluated, but rather than a mechanics for the management of behavior through the instrumental use of data extraction (here, here, and here; for the theory see Backer, Larry Catá, Global Panopticism: States, Corporations and the Governance Effects of Monitoring Regimes. Indiana Journal of Global Legal Studies, Vol. 15, 2007).  

But theory tends to bore.  And in our culture theory has become detached from the way in which knowledge is produced and understood--and employed.  One teaches now by example, and perhaps clusters examples around a theory that may help provide context to example or fashion example into instrument to be used not so much to explain or understand, but to employ to change the world around us. 

Thursday, April 16, 2015

On the Uneasy Relationship Between Learning Outcomes Assessments, Shared Governance and Academic Freedom--A View from Beneath the Administrative Apparatus at Penn State

(Pix (c) Larry Catá Backer 2015)



Learning outcomes assessment has become a very popular concept among those who seek to assert a measure of control over the university and its "product" (understood as students well equipped for insertion into appropriate segments of labor markets usually as a function of the position of the university within the prestige hierarchies in education). (See here). Sectors with a particular interest in asserting such control include political elites (for any number of reasons, judgment of these "reasons" and "justifications" is beyond the scope of this post), governmental ministries and the functionaries set to that task (usually in the form of some sort of governmental accreditation or standardization sub ministry), organizations of professionals seeking to preserve the integrity of the professions over which they assert power to set qualifications therefor (particularly the medical, legal and other professions), and of course university administrators who might see in the business of assessment a means of broadening cultures of control of the learning factories that are being constructed from out of universities in the early 21st century.

And, of course, it may be useful to faculty as well--perhaps as a means of communal self discipline, of personal improvement, as a means of retaining coherence in courses of study.  Yet, within the context in which it has arisen, faculty have been the most reluctant stakeholders to embrace this approach to the management of the business of education. Timothy Reese Cain, an associate professor at the University of Georgia’s Institute of Higher Education and a senior scholar at the National Institute for Learning Outcomes Assessment has recently produced an Occasional Paper worth considering. Timothy Reese Cain, Assessment and Academic Freedom: In Concert, Not Conflict (National Institute for Learning Outcomes Assessment Occasional Paper No. 22 Nov. 2014).  He argues that it is possible to construct systems of learning outcomes assessment that complement rather than threaten the now century old cultures of shared governance, tenure and academic freedom that are the hallmark of elite American universities.

This post considers in a very preliminary way his recommendations and their relation to efforts to construct systems of what ought to be a typical example of its type among research I universities--the  learning outcomes assessment structures at Penn State. I will approach the later as if I were an uninformed outsider considering only information publicly available.  Even this preliminary assessment suggests that if assessment becomes, in part, a system of evaluation not of courses or of programs but of faculty, then the fears about the use of assessment to end run both shared governance and academic freedom may well be realized. 

Thursday, April 2, 2015

Faculty Assessment--From "Man is the Measure of All things" to "The MEASURE is Man"


 (Pix (c) Larry Catá Backer 2015)


In many universities the Spring term signals the start of assessment season, that time when administrative superiors review and assess their faculty inferiors (from the point of view of administrative chains of command).  That assessment, increasingly has come to be understood as necessarily based on objective measures. That move has given comfort to both assessor and assessed, though for quite distinct reasons.

The objectification of the assessable individual is itself an inevitable product of the embrace by universities worldwide of a self conception increasingly described in terms of production, of learning factories (see here, here, here and here). Universities produce "things" (tangible and intangible) that can be measured, the production of which can be assigned with a fair degree of specification to various factors deployed in the production of these "things." These production lines can be structured for identification and assessment at the macro level (producing graduates for successful insertion in wage labor markets; alumni for post graduation giving; successful participants in government for access to centers of political and societal power, etc.). Yet they are also useful at the micro level (creating structured objectives to assess both instruction (maximizing content for achieving macro objective goals)), and the success in implanting those objectives into their recipients (the student)).

This post considers some of the elements and consequences of this move toward a bifurcation fo assessment along the lines of a factory model and its effects on the shape of productivity within the university.