TP Msg. #1264 The Shaping of American Higher Education - Summary and Trends

American higher education’s status, both at home and abroad, is secured by its traditional value and power. Perhaps most important now is its ability to adapt to changing conditions. No one knows what higher education will look like in coming years. The only certainty is that an open system will continue experimenting with forms and content, learning and revising as it goes, even while retaining the strengths it has developed over the past 375 years. The American people deserve no less from institutions that are part of the fabric of their society and manifestations of the nation’s self.
-----------------------------------------------------------------------------------------------------------------
"Desktop faculty development 100 times per year."
Over 49,100 subscribers at over 850 institutions in more than 100 countries
TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER
Archives of all past postings can be found at:
Sponsored by
Stanford Center for Teaching and Learning
Check out the Tomorrow's Professor Blog at:

Folks:

The posting below gives a nice summary of the history of American higher education and a look at what might be happening in the coming decades. It is from the section, Summary and Trends in the book, The Shaping of American Higher Education: Emergence and Growth of the Contemporary System, second edition by Arthur M. Cohen, with Carrie B. Kisker. Published by Jossey-Bass, A Wiley Imprint. 989 Market Street, San Francisco, CA 94103-1741—www.josseybass.com. Copyright © 2010 by John Wiley & Sons, Inc. All rights reserved. Reprinted with permission.
 

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: How to Evaluate a Faculty Governance Structure

Tomorrow's Academia
-------------------------------------------------------------- 1,462 words -------------------------------------------------------------
The Shaping of American Higher Education - Summary and Trends

This book has recounted the major trends in higher education since the Colonial Era, several of which slowed or showed distinct signs of reversal in the most recent periods. Institutions grew larger and more varied. Students gained access as institutional types emerged or evolved to serve all comers. Faculty professionalization progressed steadily, reaching a peak in the Mass Higher Education Era, before losing ground to part-time, fungible labor. The curriculum expanded, especially toward occupational studies. Institutional governance moved toward secularization and comprehensive, state-level units before decentralizing and taking on a corporate approach to management. Public funding for higher education increased throughout its first 350 years, then waned in the late twentieth and early twenty-first centuries, forcing institutions to turn to private sources for support. Finally, research and outcomes moved steadily toward the service of the individual, the public, the professions, and the economy.

Which of the trends might have been predicted when the nation was formed? Large multipurpose institutions? No. The plethora of professions that would demand years of schooling prior to practice, and an economy that would allow young people to delay entry into the workforce until they were well into their twenties were not on the horizon. Student access? Yes, because it embodies the egalitarian, democratic ideal on which the nation was founded. Faculty professionalization (and then de-professionalization)? No. The first had to await the nineteenth-century German concept Lehrfreiheit and the professionalizing of several other occupational groups, and the second followed a global restructuring of work that required a more efficient and nimble (and thus less secure) workforce. A curriculum more directly related to occupations? Perhaps. The trend was on the horizon in the last few years of the Colonial Era, as the newer colleges attempted to provide a curriculum beneficial to a variety of commercial interests. Diversified financing? Yes, because from the start the colleges relied on combinations of public funds, tuition, and donations, although the eventual magnitude and then reduction of state contributions was not foreseeable. Secular governance? Yes, because governance was interdenominational in several institutions, and attempts were made early on to involve civic leaders. But state-level governance and multi-institutional systems would have been hard to visualize because the early colleges functioned independently in scattered locations. Expectations that higher education would ameliorate social problems and enhance the economy? No. The early colleges were influential in developing men of public affairs, but the economy did not depend on college-spawned inventions or a workforce trained in postsecondary institutions.

Which trends will remain intact in the decades to come? The growth of new institutions has slowed considerably and hardly any new nonprofit campuses will be built. State, federal, and private-philanthropic funds will be available to expand campus facilities but not enough to establish entire institutions. The concept of open access, well grounded in the Mass Higher Educations Era, will survive but with limitations; smaller percentages of students will have full-time, on-campus experiences. Faculty professionalization has already made a U-turn, retarded by the massive influx of both part-timers and full-timers without security of employment. Curriculum will continue broadening, as academic inquiry sustains its pattern of generating new subspecialities and as additional occupational groups seek higher education’s cachet; all the external pressures on curriculum favor vocationalism. Secular governance has become dominant, and the only private groups able or inclined to overturn it will be those managing a growing for-profit sector. State-level control has already started giving way to decentralization, and some institutions have gone further, seeking charter or enterprise status, effectively trading governmental restrictions for increased accountability requirements. Privatization has changed the conditions of institutional finance, as colleges and universities at all levels have been forced to seek other funds in order to mitigate the effects of state support that has not increased sufficiently to accommodate rising costs and enrollments. The tendency to view higher education less as a set of social institutions than as a business enterprise will continue. As such, the colleges and universities may find themselves judged according to the same standards that are applied to any business: “To what extent does this entity add value?...And can comparable value be added more efficiently by other means?” (Schuster and Finkelstein, 2006, p. 10).

We can predict only the most powerful trends, because unforeseeable events convert specific projections into little more than informed guesses. Will the national economy return to a pattern of low inflation, low unemployment, and a balanced budget—a set of circumstances that had characterized the American economy throughout much of the Mass Higher Education, Consolidation, and Contemporary Eras, but which had been totally altered by 2009? Inflation, depression, and increased competition from other agencies will continue affecting the funds available for higher education’s support, as well as the type and mode of postsecondary training desired by students.

The study of higher education remains fascinating, with many questions open in each topic:

• The Great Depression of the 1930s saw reductions in state appropriations, foundation grants, and faculty salaries, while student enrollments continued climbing as employment opportunities declined. However, the pattern of students borrowing large sums for tuition and other college expenses had not yet become pervasive. Will twenty-first-century students continue enrolling in postsecondary institutions through depressions and recessions, or will prospective students’ reluctance to take on large debt burdens lead to reduced enrollments?

• The comprehensive universities’ offering the doctorate and the community colleges’ opening baccalaureate programs indicate that the institutions’ compulsion to expand their markets were in full flower. What does the system gain or lose thereby?

• Professional training aside, one of higher education’s main benefits has been to encourage students’ entrepreneurial skills, teaching them to operate businesses and create new products and services. As the number of high-paying jobs available to college graduates diminishes, will greater numbers of students develop and act on tendencies to create jobs for themselves?

• For the past century research and scholarly productivity has been the gold standard for faculty seeking promotion in universities. And the concept trickled down to comprehensive institutions where the alliterative, “publish or perish,” became the facetious slogan with more than a grain of truth in it. Will faculty role differentiation, as in online course design and dedication to teaching, break this mode of evaluation down completely in all but the top fifty or so research universities?

• Pressure for subdividing curriculum has come mostly from faculty and professional groups. But curricular subspecialties are expensive to maintain. As the faculty as a whole is increasingly dominated by fungibles, will curricular specialties subside and recombinations grow? Which curricular areas are most likely to evidence these trends?

• Three percent (1.5 million) of American children are home-schooled, up from 1.7 percent in 1999. Will the growing number of home-schooled students and the increasing popularity of online courses develop to the point at which virtual universities become an appealing alternative to the residential college experience for a significant percentage of students?

• As more institutions seek charter or enterprise status whereby they agree to meet certain accountability requirements in exchange for freedom from some governmental restrictions, how might their image and functionality change? Is access likely to increase? To what extent will they be viewed less as agents of the state and more as independent contractors?

• If charter or for-profit institutions are able to demonstrate that they can successfully produce similar or better outcomes in terms of student learning and research productivity than traditional public universities, are we likely to see other institutional types—community colleges, for example—becoming more like them?

Predictions aside, in the twenty-first century American higher education is the nation’s premier industry. By any measure, most of the world’s top universities are in the United States, which is the preferred destination for foreign students; American universities educate 30 percent of the total number of students who cross borders for advanced training. Furthermore, since September 11, 2001, more of them have developed overseas programs to serve international students who are unable to obtain student visas. Other rapidly developing nations such as China and India, even Dubai and Qatar, are opening new institutions, and Australia has been particularly aggressive in developing overseas programs, but it will be many decades before they can expect to attain world-class status.

American higher education’s status, both at home and abroad, is secured by its traditional value and power. Perhaps most important now is its ability to adapt to changing conditions. No one knows what higher education will look like in coming years. The only certainty is that an open system will continue experimenting with forms and content, learning and revising as it goes, even while retaining the strengths it has developed over the past 375 years. The American people deserve no less from institutions that are part of the fabric of their society and manifestations of the nation’s self.
 
References

Schuster, J. H., and Finkelstein, M. J. The American Faculty: The Restructuring of Academic Work and Careers. Baltimore, Md.: Johns Hopkins University Press, 2006.

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.


From: "Rick Reis" <reis@stanford.edu>
To: "Rick Reis" <reis@stanford.edu>
Sent: Monday, June 17, 2013 5:06:40 PM
Subject: TP Msg. #1264 The Shaping of American Higher Education - Summary and Trends

American higher education’s status, both at home and abroad, is secured by its traditional value and power. Perhaps most important now is its ability to adapt to changing conditions. No one knows what higher education will look like in coming years. The only certainty is that an open system will continue experimenting with forms and content, learning and revising as it goes, even while retaining the strengths it has developed over the past 375 years. The American people deserve no less from institutions that are part of the fabric of their society and manifestations of the nation’s self.
-----------------------------------------------------------------------------------------------------------------

"Desktop faculty development 100 times per year."
Over 49,100 subscribers at over 850 institutions in more than 100 countries

TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER
http://cgi.stanford.edu/~dept-ctl/cgi-bin/tomprof/postings.php

Archives of all past postings can be found at:
http://cgi.stanford.edu/~dept-ctl/cgi-bin/tomprof/postings.php

Sponsored by
Stanford Center for Teaching and Learning
http://ctl.stanford.edu

Check out the Tomorrow's Professor Blog at:
http://derekbruff.org/blogs/tomprof/

Folks:

The posting below gives a nice summary of the history of American higher education and a look at what might be happening in the coming decades. It is from the section, Summary and Trends in the book, The Shaping of American Higher Education: Emergence and Growth of the Contemporary System, second edition by Arthur M. Cohen, with Carrie B. Kisker. Published by Jossey-Bass, A Wiley Imprint. 989 Market Street, San Francisco, CA 94103-1741—www.josseybass.com. Copyright © 2010 by John Wiley & Sons, Inc. All rights reserved. Reprinted with permission.
 

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: How to Evaluate a Faculty Governance Structure

Tomorrow's Academia

---------------------------------------- 1,462 words -------------------------------

The Shaping of American Higher Education - Summary and Trends

This book has recounted the major trends in higher education since the Colonial Era, several of which slowed or showed distinct signs of reversal in the most recent periods. Institutions grew larger and more varied. Students gained access as institutional types emerged or evolved to serve all comers. Faculty professionalization progressed steadily, reaching a peak in the Mass Higher Education Era, before losing ground to part-time, fungible labor. The curriculum expanded, especially toward occupational studies. Institutional governance moved toward secularization and comprehensive, state-level units before decentralizing and taking on a corporate approach to management. Public funding for higher education increased throughout its first 350 years, then waned in the late twentieth and early twenty-first centuries, forcing institutions to turn to private sources for support. Finally, research and outcomes moved steadily toward the service of the individual, the public, the professions, and the economy.

Which of the trends might have been predicted when the nation was formed? Large multipurpose institutions? No. The plethora of professions that would demand years of schooling prior to practice, and an economy that would allow young people to delay entry into the workforce until they were well into their twenties were not on the horizon. Student access? Yes, because it embodies the egalitarian, democratic ideal on which the nation was founded. Faculty professionalization (and then de-professionalization)? No. The first had to await the nineteenth-century German concept Lehrfreiheit and the professionalizing of several other occupational groups, and the second followed a global restructuring of work that required a more efficient and nimble (and thus less secure) workforce. A curriculum more directly related to occupations? Perhaps. The trend was on the horizon in the last few years of the Colonial Era, as the newer colleges attempted to provide a curriculum beneficial to a variety of commercial interests. Diversified financing? Yes, because from the start the colleges relied on combinations of public funds, tuition, and donations, although the eventual magnitude and then reduction of state contributions was not foreseeable. Secular governance? Yes, because governance was interdenominational in several institutions, and attempts were made early on to involve civic leaders. But state-level governance and multi-institutional systems would have been hard to visualize because the early colleges functioned independently in scattered locations. Expectations that higher education would ameliorate social problems and enhance the economy? No. The early colleges were influential in developing men of public affairs, but the economy did not depend on college-spawned inventions or a workforce trained in postsecondary institutions.

Which trends will remain intact in the decades to come? The growth of new institutions has slowed considerably and hardly any new nonprofit campuses will be built. State, federal, and private-philanthropic funds will be available to expand campus facilities but not enough to establish entire institutions. The concept of open access, well grounded in the Mass Higher Educations Era, will survive but with limitations; smaller percentages of students will have full-time, on-campus experiences. Faculty professionalization has already made a U-turn, retarded by the massive influx of both part-timers and full-timers without security of employment. Curriculum will continue broadening, as academic inquiry sustains its pattern of generating new subspecialities and as additional occupational groups seek higher education’s cachet; all the external pressures on curriculum favor vocationalism. Secular governance has become dominant, and the only private groups able or inclined to overturn it will be those managing a growing for-profit sector. State-level control has already started giving way to decentralization, and some institutions have gone further, seeking charter or enterprise status, effectively trading governmental restrictions for increased accountability requirements. Privatization has changed the conditions of institutional finance, as colleges and universities at all levels have been forced to seek other funds in order to mitigate the effects of state support that has not increased sufficiently to accommodate rising costs and enrollments. The tendency to view higher education less as a set of social institutions than as a business enterprise will continue. As such, the colleges and universities may find themselves judged according to the same standards that are applied to any business: “To what extent does this entity add value?...And can comparable value be added more efficiently by other means?” (Schuster and Finkelstein, 2006, p. 10).

We can predict only the most powerful trends, because unforeseeable events convert specific projections into little more than informed guesses. Will the national economy return to a pattern of low inflation, low unemployment, and a balanced budget—a set of circumstances that had characterized the American economy throughout much of the Mass Higher Education, Consolidation, and Contemporary Eras, but which had been totally altered by 2009? Inflation, depression, and increased competition from other agencies will continue affecting the funds available for higher education’s support, as well as the type and mode of postsecondary training desired by students.

The study of higher education remains fascinating, with many questions open in each topic:

• The Great Depression of the 1930s saw reductions in state appropriations, foundation grants, and faculty salaries, while student enrollments continued climbing as employment opportunities declined. However, the pattern of students borrowing large sums for tuition and other college expenses had not yet become pervasive. Will twenty-first-century students continue enrolling in postsecondary institutions through depressions and recessions, or will prospective students’ reluctance to take on large debt burdens lead to reduced enrollments?

• The comprehensive universities’ offering the doctorate and the community colleges’ opening baccalaureate programs indicate that the institutions’ compulsion to expand their markets were in full flower. What does the system gain or lose thereby?

• Professional training aside, one of higher education’s main benefits has been to encourage students’ entrepreneurial skills, teaching them to operate businesses and create new products and services. As the number of high-paying jobs available to college graduates diminishes, will greater numbers of students develop and act on tendencies to create jobs for themselves?

• For the past century research and scholarly productivity has been the gold standard for faculty seeking promotion in universities. And the concept trickled down to comprehensive institutions where the alliterative, “publish or perish,” became the facetious slogan with more than a grain of truth in it. Will faculty role differentiation, as in online course design and dedication to teaching, break this mode of evaluation down completely in all but the top fifty or so research universities?

• Pressure for subdividing curriculum has come mostly from faculty and professional groups. But curricular subspecialties are expensive to maintain. As the faculty as a whole is increasingly dominated by fungibles, will curricular specialties subside and recombinations grow? Which curricular areas are most likely to evidence these trends?

• Three percent (1.5 million) of American children are home-schooled, up from 1.7 percent in 1999. Will the growing number of home-schooled students and the increasing popularity of online courses develop to the point at which virtual universities become an appealing alternative to the residential college experience for a significant percentage of students?

• As more institutions seek charter or enterprise status whereby they agree to meet certain accountability requirements in exchange for freedom from some governmental restrictions, how might their image and functionality change? Is access likely to increase? To what extent will they be viewed less as agents of the state and more as independent contractors?

• If charter or for-profit institutions are able to demonstrate that they can successfully produce similar or better outcomes in terms of student learning and research productivity than traditional public universities, are we likely to see other institutional types—community colleges, for example—becoming more like them?

Predictions aside, in the twenty-first century American higher education is the nation’s premier industry. By any measure, most of the world’s top universities are in the United States, which is the preferred destination for foreign students; American universities educate 30 percent of the total number of students who cross borders for advanced training. Furthermore, since September 11, 2001, more of them have developed overseas programs to serve international students who are unable to obtain student visas. Other rapidly developing nations such as China and India, even Dubai and Qatar, are opening new institutions, and Australia has been particularly aggressive in developing overseas programs, but it will be many decades before they can expect to attain world-class status.

American higher education’s status, both at home and abroad, is secured by its traditional value and power. Perhaps most important now is its ability to adapt to changing conditions. No one knows what higher education will look like in coming years. The only certainty is that an open system will continue experimenting with forms and content, learning and revising as it goes, even while retaining the strengths it has developed over the past 375 years. The American people deserve no less from institutions that are part of the fabric of their society and manifestations of the nation’s self.
 
References

Schuster, J. H., and Finkelstein, M. J. The American Faculty: The Restructuring of Academic Work and Careers. Baltimore, Md.: Johns Hopkins University Press, 2006.

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1263 Regular Challenges of the Dean’s Job - Making Transparency Work in Your Favor

After a few years, I found that the best defense is a good offense. Rather than reacting to misunderstandings as they arose, I use the greater fluidity of electronic communication to put my arguments out there for public consumption and debate.
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
"Desktop faculty development 100 times per year."
Over 49,100 subscribers at over 850 institutions in more than 100 countries
TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER
Archives of all past postings can be found at:
Sponsored by
Stanford Center for Teaching and Learning
Check out the Tomorrow's Professor Blog at:

Folks:

The posting below gives some good advice on improving faculty-administration communication. It is from Chapter 5, Regular Challenges of the Dean's Job, in the book, Confessions of a Community College Administrator, by Matthew Reed. Published by Jossey-Bass, A Wiley Imprint. One Montgomery Street, Suite 1200, San Francisco, CA 94104-4594 [www.josseybass.com]Copyright © 2013 by John Wiley & Sons, Inc. All rights reserved.

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: The Shaping of Higher Education: Summary and Trends

Tomorrow's Academia 
------------------------------------------------------------- 826 words --------------------------------------------------------------
Regular Challenges of the Dean’s Job - Making Transparency Work in Your Favor

Although certain personnel matters have to remain confidential, the savvy dean is well advised to assume that just about anything else could become public at any moment. Faculty talk to each other, and as anyone who has played Telephone as a kid knows, messages can get garbled in transmission.

Electronic communication has made an already porous environment much more so. Emails are forever, they can be forwarded to whomever, and they don’t convey tone or context well. (Text messages are even worse, as they`re far too short even to convey context.) Social media often blur the lines between professional and personal lives, which can lead to issues when people become inappropriately familiar. And considering the polarized politics of the external world, some enterprising demagogue could come along at any time and seize on something eyebrow raising to further some external agenda. (“Your tax dollars are paying full-time salaries to people who work only fifteen hours a week!”)
        
Even if a dean manages to keep his side deals quiet, he will quickly find that faculty are intelligent and creative people and that they`ll fill any “explanation gap" with theories of their own. Typically, the substitute explanations they generate will be far more disturbing and sinister than the truth, and they'll take “stonewalling” as confirmation. Every few months, I used to get some irate professor storming into my office connecting dots in really creative ways and using those constellations as evidence of my secret agenda to do something nefarious. Usually it was something that had never occurred to me; in a few cases, I actually laughed out loud before realizing what I was doing.

After a few years, I found that the best defense is a good offense. Rather than reacting to misunderstandings as they arose, I use the greater fluidity of electronic communication to put my arguments out there for public consumption and debate.

I tried blogging for this purpose on my campus, and once the faculty got past their initial disbelief, it became a useful part of my repertoire. I’ve been able to crowdsource some difficult dilemmas and have benefited from suggestions that l wouldn’t have received otherwise. Even better, when people are able to follow the logic behind a decision, they’re able to “agree to disagree” with decisions they don’t like, rather than ascribing them to base motives. The resulting improvement in the climate of the campus civility has been to everyone’s benefit: now we’re able to discuss difficult issues simply by discussing them.

Of course, part of improving the climate of communication involves giving up the pretense of always being right. I’ve changed my own proposals when others have come along with better ideas or with compelling critiques that I simply hadn`t thought of. Admitting “Gee, l hadn`t thought of that” can be surprisingly disarming and can actually build your own credibility over time. And that is far more important than winning every point. If you can model the behavior you want to encourage—deferring to better ideas, say—you stand a better chance of seeing more of it.

Sometimes, of course, giving others a venue means hearing things you wish weren’t true. The first time you kick some rocks over, ugly stuff will slither out. But pretending that stuff isn’t there won’t make it go away. As Hegel famously noted, “Freedom is the insight into necessity”; only by coming to grips with reality can we hope to make a real difference in it. And when people realize that they can ask difficult questions without being personally attacked or stigmatized, it becomes easier to make progress on those “everybody knows” dilemmas that typically go unaddressed for fear of ugly conflict.

When I arrived at my current college, for example, there was no “faculty only” venue for discussing academic issues. The College Senate (appropriately) comprised representatives from faculty, staff, and administration, and even the faculty union included full-time professional staff. (I never really understood the reason for that, and it led to all manner of intraunit tensions, but it wasn't my call.) During my interview, l asked one professor what the faculty were concerned about; he could only shrug and say that there was really no way of knowing. That didn’t strike me as healthy or helpful.

Shortly after arriving, l worked with the faculty to establish a Faculty Council, reporting in an advisory capacity to the chief academic officer. After some initial clarifying of boundaries—deciding which issues were really union issues, which were College Senate, and which were Faculty Council—it quickly evolved into a constructive and useful venue for both feedback on concrete proposals and the formation of new ones. The formative role was even more useful than the reactive role, as it became possible to vet ideas before working them into concrete proposals. In some cases, the quality control led to much stronger proposals; in others, it led to a mercy killing for an idea that really wasn’t ready for prime time

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1262 Using Narrative in Case Studies

In a case study you must make sense of the whole by retaining the fibres that bind a whole story together. Those fibres concern time, place, meaning, intention and much more, all interrelating.
-----------------------------------------------------------------------------------------------------------------

"Desktop faculty development 100 times per year."
Over 49,100 subscribers at over 850 institutions in more than 100 countries

TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER

Archives of all past postings can be found at:

Sponsored by
Stanford Center for Teaching and Learning

Check out the Tomorrow's Professor Blog at:

Folks:

The posting below looks at some key points in writing effective case studies.  It is by Gary Thomas and is from Chapter 10, A Toolkit for Analysing and Thinking, in the book, How to do Your Case Study: A Guide for Students and Researchers. SAGE Publications Inc., 2455 Teller Road, Thousand Oaks, California 91320. [http://www.sagepub.com/home.nav] © Copyright Gary Thomas 2011. All rights reserved. Reprinted with permission.

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: Regular Challenges of the Dean’s Job - Making Transparency Work in Your Favor

Tomorrow's Teaching and Learning 

-------------------------------------------------------- 2,076 words  ---------------------------------------------------------

Using Narrative in Case Studies

Throughout this book I have stressed the importance of the narrative – the storyline – in a case study.

In the same way that a story has coherence, integrity and progression, so must a case study. In looking at the whole you are eschewing the reductionist, fractionating methods of much social science inquiry – methods that attempt to dissolve the connecting threads and fibres that hold social phenomena together. In a case study you must make sense of the whole by retaining the fibres that bind a whole story together. Those fibres concern time, place, meaning, intention and much more, all interrelating.

The interrelationship makes sense in much the way that a story does. We cannot take one page of a novel and make very much sense of it. Nor can we extract and analyse just the sentences that contain a character’s name to work out his or her personality – we would probably form a very distorted picture of that character if we did. Rather, each character is understandable only in relation to the whole story. It’s the same in a case study.

Not only this, but the structure of a story itself adds a great deal. In stories there are assumptions about, for example, motives, intentions, jealousies, kindnesses and so on. These are things that we all understand from our daily experiences, our understanding of life, and we use this experience and these understandings to deconstruct the narrative of a case study.

The great educator-philosopher Jerome Bruner (1997: 126) goes so far as to say that narrative is at the heart of all meaningmaking, even if it is scientific meaningmaking:

The process of science making is narrative … we play with ideas, try to create anomalies, try to find neat puzzle forms that we can apply to intractable troubles so that they can be turned into soluble problems.

In his famous article in the journal of Critical Inquiry, he calls this the narrative construction of reality (Bruner, 1991: 1). I give below some key ingredients when using narrative in case studies. In doing this I have borrowed heavily from Bruner’s ‘ten features of narrative’ (1991: 3), taking away a few of them and adding a couple of my own. It is an anatomy, if you like, of storymaking. I offer these ideas as ways to extract every possible drop of juice from the story you are telling in your case study.

Questioning and surprise – intelligent noticing and serendipity

You will have ‘finds’ as you construct your narrative. Be prepared to use these – to use surprise and serendipity. Samuel Johnson (1759/1963) (that’s the famous eighteenth-century Dr Johnson) put it well: ‘Our brightest blazes of gladness are commonly kindled by unexpected sparks.’ We shouldn’t ignore these just because they fall outside the bounds of some prescribed method. When inventors and creative thinkers give us an insight into the ways that they think, it is clear that the generalisation, if it is significant, is secondary to metaphor, inspiration and imagination.

Storr (1997: 176) gives many examples of this kind of intuition in which a solution suddenly appears – he quotes from mathematician Gauss, for instance: ‘Like a sudden flash of lightning, the riddle happened to be solved. I myself cannot say what was the conducting thread which connected what I previously knew with what made my success possible.’ The same happens in social inquiry and a case study seems to be the ideal vehicle for this kind of insight, as long as it is enabled by a spirit of curiosity and not snuffed out in a relentless search for generality.

Heuristic and incremental chunking

Heuristic comes from the Greek heuriskein, meaning ‘to discover’. It’s from the same root as Archimedes’ ‘Eureka’. Archimedes, of course, jumped out of the bath with the solution to the problem of how to tell if his king’s new crown was made of pure gold or had been adulterated with silver. We now use the term heuristic to mean an explanation that is assumed to be the best in the circumstances and ‘for the time being’. Heuristics don’t have to be the best for evermore.

How do we get to that Eureka moment? How, in other words, are the elements woven together? What depends on what? Where are there contradictions or paradoxes? This ‘Eureka’ of intuition, if dissected, is similar to Simon’s (1983) tacit processes of incremental chunking. It is the putting together of related information to make a story. Be confident in doing this.

Narrative diachronicity

Narrative diachronicity? Oo-er. Not the most user-friendly term. Thanks, Professor Bruner. ‘Diachronic’ means changing over time. So, narrative diachronicity means ‘a story that changes over time’. (I know: why couldn’t he say that in the first place? Someone call the Plain English Campaign.)

Someone doing a case study should be acutely aware of change over time – and not only in a diachronic study (see page 149). He or she notices change as it happens and seeks its antecedents and consequences. We have to find the ‘sequence of steps’, as Becker puts it (1992: 209), and understand cause in relation to time, with ‘each step understood as preceding in time the one that follows it’. In doing this, we conjecture not only about how one thing is related to another but also how cause and effect change with time as other variables in a situation also change. Becker (1992: 209) gives an example:

Causes may be seen to operate, but now it is possible to treat a given casual variable as operating in different ways (or indeed not at all) at different steps in the process. In an analysis of heroin addiction, race might be a crucial variable in explaining exposure to the possibility of using drugs, but once a person has started to use drugs, race might play no further part in affecting whether people so exposed in fact use drugs, or, having used them, become addicted to their use.

So, time may switch on or switch off the potency of a variable and it is important to be aware of this since its significance is one of the ready-made, built-in advantages of the case study. While a reductionist inquiry shows the patchy significance of a variable only with great difficulty, a case study ought – by stressing the importance of the diachronic – to show how a variable such as race (in Becker’s example) may ebb and flow in its significance.

Particularity

In her novel Under the Net, Iris Murdoch (2002) has one of her characters come out with this line: ‘All theorising is flight. We must be ruled by the situation itself and this is unutterably particular.’ This is perhaps at variance with the advice I have been giving about the need for theorising and there is an apparent contradiction here. Certainly, if theory is about generalisation, there is a tension to be resolved – something I discuss further on page 211.

Without going into the ins and outs of this now, what Murdoch is getting at is that there is a uniqueness to a particular situation and we should seek to understand this without what the philosopher Michael Oakeshott (1967: 2) calls the ‘irritable search for order’. We should not always judge this situation and its significance by reference to others but by reference to the particular.
This may call for a special effort of will from the student or professional researcher, given the ever-present desire to establish, develop and refer to a certain kind of generalising theory among social scientists.

Intentional state entailment

Bruner notes that we should observe not just what people do, but what they think and feel. It is their beliefs, intentions, hopes, desires and values that are important. There is nothing different here from the thick description of the interpretive inquirer (see page 124). It should be the unselfconscious hallmark of those doing case studies.

Breaching the canon … and counter-factuality

Using the rather ugly word canonicity, Bruner (1991: 11) asks us to consider what is usual, normal, in a line of reasoning or the unfolding of an argument or a story. This is the ‘canon’ – it’s the realm of what we expect. By suddenly throwing a spanner in the works, we can jolt our readers into thinking differently – perhaps differently enough to imagine an alternative explanation or a different state of affairs.

As narratives, case studies have the function of letting us understand and recognise how they differ from what is normal or expected. They let us guess how and why this may be so. Feyerabend (1993) suggested that we may use counterrules. These are hypotheses that contradict well-established thinking of one kind of another. Kuhn (1970: 52) suggested something similar in what he called the ‘awareness of anomaly’.

Such a breach can be engineered by the deliberate introduction of an imaginary change of understanding, which is why I’ve taken the liberty of adding ‘counter-factuality’ (Kahneman and Tversky, 1973; Mandel et al., 2005) to the heading above using Bruner’s phrase.

Counter-factuality is the imagination of a different state of affairs. This might exist if a particular event (usually, though not necessarily, a key one) had not occurred or if there had been some other outcome from it. Counter-factuality exists, in other words, in ‘What if … ?’ questions.

The idea has been employed by historians (Ferguson, 1999), though it has not been widely used as part of the method for carrying out a case study in the social sciences. I’d like to see it used more. Ragin (2007: 63) has discussed its use, as has Lebow (2007). Interestingly, Ruth Byrne (2005) discusses how central a role counter-factuality takes in our everyday reasoning, showing how different kinds of reasoning – ‘What if ..?’, ‘If only …’, ‘Even if …’ – can be refracted through the counter-factuality lens. If only more case study inquiries (or, indeed, inquiries in general) used such aids to the imagination …

Context sensitivity and negotiability

Perhaps in the same way that Barthes (1974) talks about ‘writerly’ texts, in which the meaning is (perhaps confusingly) created by the reader (as distinct from ‘readerly’ texts), so the assumption should be that the interpretation of the case is embedded in the inquirer’s (and the reader’s) own experiences.

Interpretation is personal. It is sensitivity to context that enables readers to make sense of the narrative of the case and agree or disagree with the research. As Bruner (1991: 17) puts it: ‘You tell your story, I tell mine, and we rarely need legal confrontation to settle the difference.’

Analogy

We make sense of the unfamiliar by reference to the familiar, drawing likenesses between one situation and another. We use our own knowledge to do this, our ‘common sense’. Our understanding is based on myriad personal interpretations we weave together into meaningful stories that help us to make sense of similar events and situations, similar plotlines.

The narrative that a case study lets you draw can be the ideal frame for enabling such analogy and metaphor. Tavor Bannet (1997: 655) discusses analogy and, interestingly, says that it is a, ‘method of reasoning from the known to the unknown, and from the visible to the speculative’ by carrying familiar terms and images across into unfamiliar territory. It is like a form of translation, ‘a way of transporting something from place to place, from old to new, from original to copy’, and we can therefore move from one context to another. We bring together, juxtapose and see similarities across contexts.

In discussing the importance of narrative in the case study, Abbott (1992) suggests that we should always be seeking what he calls ‘causal narrativity’, but I personally prefer to suggest that, in social science, we are, as with ‘theory’, making connections rather than trying to find causes. Becker (1998: 60-61) puts this very nicely: he suggests that the use of the word ‘cause’ is a misnomer in social research, given its complexity, so, we should see ourselves as seeking narrative rather than a cause:

Assume that whatever you want to study has, not causes, but a history, a story, a narrative, a ‘first this happened, then that happened, and then the other happened, and it ended up like this.’ With this view we understand the occurrence of events by learning the steps in the process by which they came to happen, rather than by learning the conditions that made their existence necessary.

It is the case study that enables such creativity – allows you to suggest these bridges and passages between ideas.
 

References

Abbott, A. (1992) ‘What do cases do? Some notes on activity in sociological analysis’, in C.C. Ragin and H.S. Becker, What is a case? Cambridge: Cambridge University Press.

Barthes, R. (R. Miller, trans.) (1974) S/Z. New York: Hill & Wang.

Becker, H.S. (1992) ‘Cases, causes, conjunctures, stories, imagery’, in C.C. Ragin and H.S. Becker, What is a Case? Cambridge: Cambridge University Press.

Becker, H.S. (1998) Tricks of the Trade. Chicago, IL: University of Chicago Press.

Bruner, J. (1991) ‘The narrative construction of reality’, Critical Inquiry, 18(1): 1-21.

Bruner, J. (1997) The culture of Education. Cambridge, MA: Harvard University Press.

Byrne, R.M.J. (2005) The Rational Imagination: How people create alternatives to reality. Cambridge, MA: The MIT Press.

Ferguson, N. (1999) Virtual History: Alternatives and counterfactuals. New York: Basic Books.

Feyerabend, P. (1993) Against Method (3rd edn). London: Verso/New Left Books.

Johnson, S. (1759/1963) ‘The Idler, no. 58, Universal Chronicle’, in W.J. Bate, J.M. Bullitt and L.F. Powell (eds). Works of Samuel Johnson, Vol. 2. London: Yale University Press.

Kahneman, D. and Tversky, A. (1973) ‘On the psychology of prediction’, Psychological Review, 80 (4): 237-51.

Kuhn, T.S. (1970) The Structure of Scientific Revolutions. Chicago, IL: University of Chicago Press.

Lebow, R.N. (2007) ‘Counterfactual thought experiments: a necessary teaching tool’, The History Teacher, 40 (2) (available online at: www.historycooperative.org/journals/ht/40.2/lebow.html).

Mandel, D.R., Hilton, D.J. and Catellani, P. (2005) The psychology of Counterfactual Thinking. Abingdon: Routledge

Murdoch, I. (2002) Under the Net. London: Vintage.

Oakeshott, M. (1967) Rationalism in Politics and Other Essays. London: Methuen.

Ragin, C.C. (2007) ‘Comparative methods’, in W. Outhwaite and S.P. Turner, The SAGE Handbook of Social Science Methodology. Los Angeles, CA: Sage. Pp. 67-81.

Simon, H. (1983) Reason in Human Affairs. Oxford: Basil Blackwell.

Storr, A. (1997) Feet of Clay: A study of gurus. London: Harper Colli

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1261 Deploying Collaborative Leadership to Reinvent Higher Education for the Twenty-First Century

As with many other sectors of our society, new forms of leadership are emerging in higher education. Higher education has the opportunity to cultivate these forms of leadership both in our students and in ourselves. And we have good initial examples of collaborative leadership and collective impact on which we can build and from which we can learn.
-----------------------------------------------------------------------------------------------------------------
"Desktop faculty development 100 times per year."
Over 49,000 subscribers at over 850 institutions in more than 100 countries
TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER
Archives of all past postings can be found at:
Sponsored by
Stanford Center for Teaching and Learning
Check out the Tomorrow's Professor Blog at:

Folks:

The posting below looks at the importance of collaborative leadership in higher education institutions.  It is by Debra Humphreys, vice president for policy and public engagement, AAC&U and is from is from Peer Review, Winter 2013, Vol. 15, No.1. Peer Review is a publication of the Association of American Colleges and Universities [http://www.aacu.org/peerreview/index.cfm Copyright © 2013, all rights reserved. Reprinted with permission.

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: Using Narrative in Case Studies

Tomorrow's Academia
----------------------------------------- 2,103 words -----------------------------------
Deploying Collaborative Leadership to Reinvent Higher Education for the Twenty-First Century 

Since the launch of its national Liberal Education and America’s Promise (LEAP) initiative in 2005, the Association of American Colleges and Universities (AAC&U) has commissioned four national surveys of employers (AAC&U 2007; AAC&U 2008; AAC&U 2010; and AAC&U 2013). In those surveys, business and nonprofit leaders across a wide array of sectors provided information about what new college graduates need to know and be able to do to succeed in the twenty-first-century global economy. Consistently, employers say that “teamwork skills,” especially deployed effectively in diverse settings, are essential for success in today’s world. More than 70 percent of those surveyed in 2010 said they thought higher education institutions should place more emphasis on developing this skill in all college graduates. In the 2013 study, more than 90 percent agree that “all students should have educational experiences that teach them how to solve problems with people whose views are different from their own.” Business and nonprofit leaders clearly believe that having employees that are adept at teamwork will assist them in succeeding in a volatile and competitive global economy. More and more, businesses are also encouraging and cultivating leaders who can collaborate not only within their companies, but also with other partner organizations and companies. Collaborative leadership is seen now as a competitive business advantage.

Higher Education and Collaborative Leadership

For years, many individual faculty members and academic administrators have been creating new classroom practices and curricular models designed specifically to advance the skills of teamwork and collaboration in today’s college students. Other earlier editions of this journal have highlighted some of the more successful of these programs (Carey 2010; Carey 2011; Carey 2012a; Carey 2012b). However, too little attention has been paid to date to how teamwork is deployed within higher education institutions themselves. How are institutions supporting and advancing forms of “collaborative leadership” to improve their own capacity to navigate an equally volatile and challenging environment?

Just as in the business community, today’s challenging environment in and for the higher education sector demands more collaborative leadership—especially put to use to bridge even more sectors and divides than in the past. The higher education sector is a unique and complex set of institutions—public, private, for-profit, nonprofit—which are highly regulated by a variety of entities. Higher education’s organizational structures and the pressures on its unique business models are poorly understood by nearly everyone outside of the sector and many individuals within the sector, including some of its leaders. The need to increase understanding of institutional goals and practices in higher education highlights even further the necessity of collaboration and the cross-sector communication it requires and enhances.

If we are to meet increasing demands for a more highly educated populace while also maintaining quality and navigating changes in technology, funding patterns, accountability frameworks, and the diversity of our student bodies, we urgently need more effective and widespread collaborative leadership. Only through collaborative leadership can we hope to (1) develop greater understanding of our enterprise among the public, policy makers, students, parents, and members of the media in order to garner the financial and regulatory support we need to maintain healthy institutions; (2) increase the efficiency with which we maintain the quality of our operations; and (3) develop more effective ways to actually educate a far wider proportion of the society to meet twenty-first century demands. Whether our current fiscal challenges really represent a “new normal” or not, we must accelerate the use of new forms of collaborative leadership to extend the advantages of a twenty-first century liberal education to more students and, thereby, help fuel both an economic and a democratic recovery.

The concept of collaborative leadership has been gaining traction in the business community for years (Kanter 1994) and—in its most basic form—encompasses an emerging body of theory and management focused on leadership skills that deliver results across organizational boundaries. Most recently, the concept of collaborative leadership has been deployed not only in business but also in public policy and community organizing through a concept called “collective impact.” In a recent blog post in the Harvard Business Review, Ben Hecht suggests that, while the concept of collaborative leadership is not a new one, “what we’re seeing around the country is the coming together of nontraditional partners and a willingness to embrace new ways of working together” (2013). This issue of Peer Review asks if we are seeing the same trend in higher education, whether it is having a positive impact, and, if so, whether it can be expanded to more institutions and more individuals within colleges and universities.

As with many “new ideas,” instances of collaborative leadership or collective impact have abounded for years within higher education. The challenge is to figure out which of these examples have the most promise to expand and have a more systematic impact on institutional practices and educational outcomes. One can point, for instance, to the decades-long focus on the “scholarship of teaching and learning” that challenges the idea of the separation of solitary research pursuits from the attempt to improve the learning outcomes for undergraduates at both the classroom and program levels. As Pat Hutchings and her colleagues recently noted in The Scholarship of Teaching and Learning Reconsidered, “Problems that were once the province of isolated pedagogical specialists are increasingly the shared concern of all who teach in higher education….In short, a rather extraordinary development is underway: the emergence in higher education of a teaching commons…[and] communities of educators committed to pedagogical inquiry and innovation” (ix).

For decades, select leaders in student and academic affairs have exercised collaborative leadership to advance more experiential learning opportunities for students. Such efforts have resulted in community-based research and service-learning opportunities that research suggests have profound impact on increasing student retention rates and on advancing important liberal education learning outcomes (Brownell and Swaner 2010). Unfortunately, too many institutions still do not recognize the scholarship of teaching and learning in tenure and promotion policies, and community-based research and service-learning programs still only involve a small fraction of all undergraduates. Is it time to bring these collaborative practices into the center of our organizational and educational practices?

Beyond these long-standing examples of internal collaboration, are there new collaborations we can and should be developing? For example, how can higher education leaders collaborate far more closely with business and nonprofit leaders to build understanding of what quality undergraduate education really must entail in the twenty-first century and, even more powerfully, develop more opportunities for current students to apply what they are learning in real-world settings with guidance from both educators and workplace or community mentors? How can educational leaders work much more closely with policy makers—including system heads and state higher education executive officers as well as legislators at both state and federal levels—to craft sensible policies that advance multiple goals for greater efficiencies, increased graduation rates, and quality learning outcomes for more students? This issue of Peer Review examines some of these traditional and new forms of collaborative leadership, all with an eye toward more systemic change to advance increasingly urgent goals for higher education institutions to become more productive and efficient while also raising levels of student achievement.

Lessons from the Collective Impact Movement

The good news is that we do have examples that, while isolated, already are having an impact and can provide models for higher education. What are the ingredients for success we might identify in good examples that might help us to bring them to scale? In his blog post referenced above, Hecht suggests that the collective impact movement that is bridging traditional sectors and boundaries to solve complex social problems offers five lessons for making this kind of effort successful. These lessons seem apt for higher education institutions as well. Lesson one is the necessity of clearly defining “what we can do together that we could not do alone.” For instance, can we really advance the levels of cross-cutting capacities in today’s college graduates if we don’t create many more opportunities for faculty—both full-time and part-time—to collaborate with each other to design curricula and compare notes on individual classroom designs and assignments? Can we bring more students to higher levels of achievement with more collaboratively designed curricula that scaffold experiences that build one on another? Can we improve teaching and learning practices more quickly if faculty members collaborate with one another on actually testing what works and what doesn’t across different disciplines, with different students, in different classroom settings (e.g. large, small, online, face-to-face, blended, flipped)? Can we really advance the completion agenda without collaboration among educators and policy makers to craft a common understanding of what high-quality learning really means in the twenty-first century?

Lesson two from the collective impact movement is to “transcend parochialism.” Higher education institutions can no longer thrive as precious islands of intellectual contemplation for small groups of mostly privileged students. Smaller private and public institutions must collaborate with one another, create tighter connections to their own local communities, and use information technology to connect their students to broader learning communities around the world. Higher education institutions of all sorts must be open to learning from other institutions, including those from different sectors. Community colleges have much to teach four-year institutions about tight community connections, responsiveness to business and policy maker needs, and success in educating underprepared students or students from communities traditionally not served well by higher education.

Lesson three is to “adapt to data.” Colleges and universities are, indeed, collecting far more data than ever before about their students—what they think, what they can do, what they are learning, where they go after they leave college. Educational leaders, however, are well aware that we too infrequently use such data to actually change practices and policies. A recent survey of chief academic officers (CAOs) sponsored by Inside Higher Ed found that, while three-quarters of all CAOs report that their institutions are generating data on student learning outcomes, only about 30 percent rate their own institutions as effective in “using data to aid and inform campus decision-making” (2013: 11). We clearly have work to do to bring together the necessary groups of individuals to make the best use of the data we are collecting.

We also are probably too cautious in actually acting on data before the full analysis is complete. Outside of higher education, there is far more willingness to “make adjustments on the fly,” as Hecht puts it. Academic leaders, in particular, have a crucial role to play in enabling faculty members and student affairs professionals to take risks and redesign curricula and student experiences. As José Antonio Bowen put it in a presentation at AAC&U’s 2013 annual meeting, academic deans must be in the business of “curating risk.” Data-driven decision making can include significant structural changes based on years of data tracking. It can also, however, involve trying out a new approach based on very preliminary data—knowing that it might not work and/or that it is likely to require modification over a period of time. It requires new forms of collaborative leadership exercised by those in such areas as institutional research, outcomes assessment, teaching and learning centers, and enrollment management.

Lesson four is to “feed the field.” AAC&U and other organizations like it play a crucial role in spreading the word about which collaborations are working, which innovations seem to hold promise, what even small-scale research might tell us about how to improve outcomes. AAC&U’s publications, research, and meetings on how educators can act on emerging research on “high-impact practices” is a prime example of this “feeding the field” to generate innovation and scale (Brownell and Swaner 2010; Kuh 2008).

Finally, Hecht suggests that collective impact requires institutions to create and “support the backbone.” Collaborative efforts in any setting cannot be successful if they are built on purely voluntary efforts by the early-adopters and the “true believers.” Educational leaders must enable “full-time” individuals to include collaboration as part of their “day jobs.” Even though it is powerful and necessary, collaboration is also messy and time consuming. We must find ways to stop doing other things that may no longer be necessary in order to “support, nurture, and feed the collaboration.”

As with many other sectors of our society, new forms of leadership are emerging in higher education. Higher education has the opportunity to cultivate these forms of leadership both in our students and in ourselves. And we have good initial examples of collaborative leadership and collective impact on which we can build and from which we can learn.

References

Association of American Colleges and Universities and Hart Research Associates. 2007. How Should Colleges Prepare Students to Succeed in Today’s Global Economy? Washington, DC: Association of American Colleges and Universities.

———. 2008. How Should Colleges Assess and Improve Student Learning? Employers’ Views on the Accountability Challenge. Washington, DC: Association of American Colleges and Universities.

———. 2010. Raising the Bar: Employers’ Views on College Learning in the Wake of the Economic Downturn. Washington, DC: Association of American Colleges and Universities.

———. 2013. It Takes More than a Major: Employer Priorities for College Learning and Student Success.

Carey, S. J., ed. 2012. “Frontiers of Faculty Work: Embracing Innovation and High-Impact Practices.” Peer Review 14, no. 3.

———. 2012. “The Liberally Educated Professional.” Peer Review 14, no. 2.
———. 2011. “Advancing What Works in STEM: A View from the PKAL Lens.” Peer Review 13, no. 3

———. 2010. “Internships and Experiential Learning.” Peer Review 12, no. 4.

Green, K. C. 2013. The 2011–12 Inside Higher Ed Survey of College and University Chief Academic Officers (Washington, DC: Inside Higher Ed).

Hecht, B. 2013. “Collaboration is the New Competition.” Harvard Business Review Blog Network (January 10, 2013).

Hutchings, P., et. al. 2011. The Scholarship of Teaching and Learning Reconsidered: Institutional Integration and Impact. Stanford, CA: Carnegie Foundation for the Advancement of Teaching and Jossey-Bass.

Kanter, R. M. 1994. “Collaborative Advantage.” Harvard Business Review 72, no. 4: 96–108.
 

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1260 Exam Wrappers

Exam wrappers are short activities that direct students to review their performance (and the instructor’s feedback) on an exam with an eye toward adapting their future learning. Exam wrappers ask students three kinds of questions: How did they prepare for the exam? What kind of errors did they make on the exam? What could they do differently next time? Each of the question types is discussed next.
-----------------------------------------------------------------------------------------------------------------

"Desktop faculty development 100 times per year."
Over 49,000 subscribers at over 850 institutions in more than 100 countries

TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER

Archives of all past postings can be found at:

Sponsored by
Stanford Center for Teaching and Learning

Check out the Tomorrow's Professor Blog at:

Folks:

The posting below looks at using a new and very interesting tool called "exam wrappers" to enable students to think more carefully about their studying and learning. It is from Chapter 2, Make Exams Worth More Than the Grade, by Marsha C. Lovett in the book, Using Reflection and Metacognition to Improve Student Learning, edited by Matthew Kaplan, Naomi Silver, Danielle LaVaque-Manty, and Deborah Meizlish. Published by Stylus Publishing, LLC 22883 Quicksilver Drive, Sterling, Virginia 20166-2102. http://www.styluspub.com/Books/Features.aspx Copyright © 2013 by Stylus Publishing, LLC. All rights reserved. Reprinted with permission.

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: Deploying Collaborative Leadership to Reinvent Higher Education for the Twenty-First Century

Tomorrow's Teaching and Learning

--------------------------------------------------------- 2,267 words -----------------------------------------------------------

Exam Wrappers

Design Consideration for Exam Wrappers

To devise a practical and effective intervention that helps students develop metacognitive skills, we need to consider several realities of teaching and learning. First, however much instructors may value metacognition, they still face great pressure to cover the course content (especially in introductory course) and hence must allocate their class time sparingly. So any practical intervention must impinge minimally on class time. Second, today’s college students are busy and as such tend to be highly sensitive to the time they spend on course-related activities, especially if they do not see a connection to their grade or the course content. So students must be able to complete any practical intervention within the (likely small) amount of time they are willing to invest. Third, courses vary widely in many different ways, including the disciplinary content (e.g., biology versus physics), format of the course (e.g., lecture versus small-group discussion), and types of activities (e.g., problem set versus essay), and instructors do no want to have to design a distinct instrument for every course. So any practical intervention must be easily adaptable across diverse course features. Fourth, in order to produce significant learning gains, instructors need to give students repeated practice opportunities. Moreover, the repetitions need to allow enough variety, to avoid seeming dull and predictable, and to support transfer. So any effective intervention must be repeatable and yet flexible enough to accommodate variation in format. Finally, and most importantly, metacognition will not improve unless students are actively engaging in metacognitive practice of the sort discussed earlier. In other words, to be most effective, the intervention must be (a) targeted on the metacognitive skills that instructors want their students to learn, (b) repeatable from multiple practice opportunities, (c) exemplified in diverse contexts, and (d) grounded in the content of students’ disciplinary learning.

For the reasons identified in the beginning of the chapter, exams offer an ideal platform for achieving metacognitive gains. My approach was to build metacognitive practice around exams and in so doing satisfy the previously listed constraints. As the name suggests, this is what exam wrappers are all about.

What are Exam Wrappers?

Exam wrappers are short activities that direct students to review their performance (and the instructor’s feedback) on an exam with an eye toward adapting their future learning (again, see Appendices A1 and A2 for two samples). Exam wrappers ask students three kinds of questions: How did they prepare for the exam? What kind of errors did they make on the exam? What could they do differently next time? Each of the question types is discussed next.

1. How students prepare for the exam. Asking students to reflect on how they prepared for the exam forces them to confront the choices, explicit or implicit, they made about their studying. This prompts students to consider issues such as whether they studied enough or sufficiently in advance. Similarly, asking students which of various study strategies they employed (e.g., reviewing notes, solving practice problems, rereading the textbook) highlights that there are many options they could have taken. It also presents various study strategies that students might not have even considered and thus suggests some new possibilities for how they might prepare differently next time.

2. What kind of errors students made. Once they have received a grade, students do not always think carefully about their performance on an exam. If they did well, they might mark it as a success without much further thought; if they did poorly, there’s strong temptation to leave the painful event behind. Thus, the second set of questions posed in exam wrappers is designed to encourage students to analyze their performance in greater depth, giving students something constructive to do with a feedback a graded exam offers. One way to do this is to identify the critical components or stages of the tasks on the exam and have students estimate their degree of difficulty (e.g., how many points they lost) with each component. For example, did they read the question carefully, did they have trouble “setting up” the problem, did they fail to understand the concepts involved, or did they make mistakes on the required arithmetic or algebra? Focusing students’ reflection at this level informs their analysis of their own performance. Moreover, the labels for the different possibilities provide a concrete language for students to use when assessing their own performance. Note that this part of the exam wrapper is a natural place for instructors to tailor the questions to their own needs. For example, the exam wrappers in Appendices A1 and A2 use different labels to fit the needs of two disciplines: physics and calculus. Instructors may also want to adapt these labels to include specific misconceptions or difficulties that have been revealed in their course by past students. Or, they may want to include more general issues that impact students' exam performance. For instance, an instructor I worked with recently was concerned about test anxiety adversely affecting her students’ exam performance, so she incorporated this issue into her exam wrapper.

3. How students should study for the next exam. Students can use their responses to the first and second types of exam-wrapper questions to think about how they should approach the next exam. A key goal of the third type of question exam-wrapper question is to help students see the association between their study choices and their exam performance so they can better predict what study strategies will be effective in the future. One way to do this task is to ask students to look back at their responses to the first two parts of the wrapper and then to list specific ways they might prepare differently for the next exam to improve their performance. Another option is to prompt students to attribute their various difficulties (from part two of the wrapper) to specific study strategies (from part one) they did or did not employ. Rather than merely telling students to “study harder” or “do more practice problems before the exam,” this third type of exam-wrapper question helps students discover effective study strategies on their own. In effect, exam wrappers are asking students to give their future selves advice.

Why Exam Wrappers Work

The earlier section on design considerations described five constraints that a metacognitive intervention should satisfy to be practical and effective. Understanding the ways in which exam wrappers satisfy these constraints helps explain why they work.

1. Impinge minimally on class time. Exam wrappers require only a few minutes and are completed at a time when students arguably are somewhat distracted anyway. Moreover, instructors can eliminate even this minimal impact on class time by giving exam wrappers as part of homework.

2. Be as easily completed by students within the time they are willing to invest. With typically only one page of questions, none of which requires much writing, exam wrappers take relatively little student time.

3. Be easily adaptable. As we have seen, exam wrappers include three main question types, and these question types can be applied to almost any course—as long as it has exams. (See the following section, How to Use Exam Wrappers, for different ways of implementing exam wrappers.) In addition, this general approach can be applied to any type of graded assignment. (See the section titled Other Kinds of Wrappers for a brief discussion of other ways to employ this type of tool.)

4. Be repeatable yet flexible. The core questions being in an exam wrapper do not diminish in value when asked repeatedly. At the same time, it is easy to adjust the details of exam wrappers so as to keep the exercise fresh. Instructors can easily vary the specific content of exam wrapper questions, add new questions, and tailor the questions to their particular instructional situation. (See Appendix B for two additional exam wrappers beyond those presented in Appendices A1 and A2.)

5. Exercise the skills instructors want their students to learn. The reflections required to complete an exam wrapper leads students to assess their own strengths and weaknesses, evaluate their performance, identify which strategies work for them, and generate appropriate adjustments. These are key metacognitive skills that many instructors want to promote.

How to Use Exam Wrappers

Here I describe a basic recipe for how to use exam wrappers, along with variations and options instructors may find useful.

Step1: Students prepare for and take the exam using their typical study strategies. No special intervention is need for this first exam.

Step 2: The instructor gives students the exam wrapper instrument when the graded exams are returned and asks students to complete the exam wrapper as soon as possible upon seeing their exam performance. Ideally, this is done right then in class and need only take 10 minutes of class time. But there are other possibilities. Students can complete the exam wrapper as homework, submitting their responses by a specified deadline. Or students can complete the exam wrappers online as a nongraded assignment (e.g., within a course management system or online instructional environment or with an online survey system).

Step 3: The instructor collects the exam wrappers. Although exam wrappers are not graded activities, it is important to collect them because (a) the exam wrapper will need to be returned to students at a later point (see Step 4) and this prevents them from getting lost, and (b) the instructional team may want to review students’ responses to gain insight into their students’ learning that they otherwise might not be able to obtain. In particular, the instructor or teaching assistants can skim students’ responses to see whether there are patterns in how students analyzed their strengths and weaknesses or in how students described their approach to studying for the exam. For example, instructors may be surprised to learn the amount of time students spent studying (either how much or how little), when students chose to start their studying (e.g., 2 a.m. the night before), or how students spent their study time (e.g., memorizing formulae rather than solving practice problems). The instructional team can also consider the additional instructional support students said they would like to receive and possibly provide something along these lines. A wide variety of adjustments may be suggested based on what the instructional team learns from the exam wrappers about students’ strengths and weaknesses, and study strategies.

Step 4: At the time when students should begin studying for the next exam, the instructor returns the completed exam wrappers (from the previous exam) to students. The idea here is that students review their own recommendations for how to study more effectively, given their own past experiences, strengths, and weaknesses. Depending on the class format and the time available, there are many variations on this step that instructors can use. For example, Figure 2.1 shows a set of follow-up questions that can accompany the completed exam wrapper sheet. These questions prompt students to review their exam wrapper responses and recommit to implement their own suggestions. Another option (not mutually exclusive) that works well with similar classes is to give students a few minutes to reread their exam wrappers and then take a few minutes for students to share effective study strategies. Regardless of which approach instructors take for this step, the key aspect involves reminding students of their own advice and encouraging them to take it.

Step 5 (optional, but desirable): Repeat steps 2 through 4 for subsequent exams.

When an instructor provides exam wrappers regularly across multiple exams, students get repeated practice in applying the skills of self-regulated learning. This helps students build a habit of mind to monitor their own learning, reflect on their study strategies, and make appropriate adjustments. For reasons mentioned earlier, it can be useful to include nontrivial variation in the structure of subsequent wrappers while still prompting the desired metacognitive processes. For example, an exam wrapper used for an exam later in the semester can be streamlined compared to the first exam wrapper. Having the wrapper still gets students to engage in reflection and analysis, but fading the scaffolding encourages students to take on more of the responsibility for this process.

These five steps are easy to implement, take relatively little time, and are very flexible. The metacognitive practice from using wrappers in a course offers substantial benefits. And when multiple instructors do this across different courses, students can learn metacognitive skills in multiple contexts, thereby increasing their likelihood of transferring the skills to new learning situations in the future. This is exactly what we did at Carnegie Mellon University, implementing wrappers in several introductory math and science courses, as described in the next section.

Figure 2.1 Exam wrapper add-on: Additional questions for when completed wrapper is returned

Physics Pre-Exam Reflection                                                               Name:

You will soon be taking Exam #2. This sheet poses a few questions to help you reflect on your experience with Exam #1 so that you can prepare effectively for Exam #2.

1. Read through your responses on the Post-Exam Reflection sheet from the last exam. (Your TAs will hand back your sheet.) Jot down anything you read that you think will be helpful as you study for the next exam.

2. Self-assessment involves analyzing your own strengths and weaknesses. This can be helpful in deciding what you should study more or less. Given your responses on the Exam #1 reflection sheet along with your experiences learning new topics for Exam #2, what do you think you should study most as you prepare for Exam #2?
      
3. Read your responses to question #4 on your Post-Exam Reflection sheet. Write down how you plan to implement your suggestions to study effectively for Exam #2.

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1259 Motherhood: How Faculty Manage Work and Family

The book is based on a longitudinal set of interviews with tenure track women with young children at a variety of institutional types and disciplines.  It book focuses on how women managed work and family at the early career stage (when they face the dual pressures of tenure and infants) and then again as these same women face midcareer challenges and school aged children.  The book shows that managing work and family life is doable and that as women’s academic careers and families evolve they face different kinds of challenges and pressures.
-----------------------------------------------------------------------------------------------------------------

"Desktop faculty development 100 times per year."
Over 49,000 subscribers at over 850 institutions in more than 100 countries

TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER

Archives of all past postings can be found at:

Sponsored by
Stanford Center for Teaching and Learning

Check out the Tomorrow's Professor Blog at:

Folks:

The posting below is a summary by the author, Lisa Wolf-Wendel, professor, Education Leadership and Policy Studies Department, School of Education, University of Kansas, Lawrence, KS  [lwolf@ku.edu] of some of the key points in her book, Academic Motherhood: How Faculty Manage Work and Family (published by Rutgers University Press, 2012). The book is the winner of the Outstanding Publication Award from AERA, (American Educational Research Association, Division J.

Regards,

Rick Reis
reis@sanford.edu
UP NEXT: Exam Wrappers

Tomorrow's Academic Careers

-------------------------------------------------------- 1,223 words -----------------------------------------------------------

Motherhood: How Faculty Manage Work and Family 

Institutions of higher education are increasingly recognizing that being “family friendly” is an asset in terms of recruiting and retaining top faculty members.  Over the last decade, an increasing number of colleges and universities have instituted a variety of policies for new parents including tenure clock extensions, reductions in teaching duties, and parental leaves, to name just a few.  In terms of policies and accommodations much of the focus is on junior faculty and accommodating birth; there is much less attention to the work/family needs of midcareer or more senior faculty – it is as if institutions assume that once faculty earn tenure and once children get older that managing work and family integration will come naturally and not require institutional support. Our research shows that this is not necessarily a safe conclusion, especially for women faculty with children. The academic career and parenthood are both lifelong commitments and institutions of higher education are best served by recognizing this and responding affirmatively. Failure to do so could result in continued gender stratification in the profession and possibly the loss of talented professionals in the field.

Brief Overview of the Findings

The early career results show that the academic career is consuming and greedy (as is parenthood), but that the autonomy and flexibility of the position make managing multiple roles possible. There is no question that being on the tenure track is intense and that the probationary period is stressful. There also is no question that taking care of an infant is a time-consuming task -- and mothers often bear the brunt of those duties. Time is a precious commodity for new mothers and for faculty on the tenure track and the tension comes from trying to fulfill one's multiple roles well within existing time constraints. Despite this pressure, tenure-track women faculty with young children find joy in their multiple roles.  During the early career stage, even when policies are available, faculty members are reticent to use them.
 
Midcareer faculty were less stressed about managing work and family but were, in general, not making the progress towards professional advancement as hoped.  Parenthood becomes a little easier as well. Family concerns shift from diapers and breast-feeding to carpooling and school activities. Faculty concerns shift, too. No longer is earning tenure the goal, now women are engaging in more service and more advising and are beginning to think about promotion to full professor. Mid-career women faculty are more settled and less stressed -- but they aren't always making the kind of progress towards promotion as we might like. They still need attention and support from their institutions and this is often lacking. Because the tenure process (and babies) is so time-consuming and stressful, there is a tendency for people and institutions to not focus on what happens next -- but being a faculty member and being a parent are lifelong commitments.

At both career stages, women were “making it work” through their own efforts and choices and relied little on assistance from their institutions or their departments. It is important for faculty to manage their own lives; but academic institutions play an important role in assisting junior faculty as they navigate the hurdles of tenure and mid-career faculty as they develop into successful senior scholars.  

Institutional Policy Recommendations

The most important thing campuses need to do is not just have policies, but to, more importantly, let people know they can use the policies. We refer to this as a "culture of use." Campuses need to make faculty aware of policies and let faculty know they can use those policies without fear of professional or personal retribution. This requires a cultural shift on behalf of all members of the campus, not just the faculty in need of the policy. Policies have to be known, easy to find, and useable.

In addition to promoting family-friendly cultures we also recommend the following as some things to consider with regard to policy and its use.
• Tenure and biological clocks click simultaneously -- campuses need to be aware of this biological reality for most women.
• FMLA is not enough -- it's a start, but it's not enough to have as a default. Family-friendly policies must be more comprehensive.
• Parenthood is not just a women's problem -- men and women are both dealing with work and family concerns, although women do have unique needs based
  on the physical realities of pregnancy, child birth, and breast-feeding.
• Move away from "making deals" -- equitable policy environments grant all faculty access to policies. Success at navigating work and family should
  not just be a matter of personal agency.
• One size may not fit all -- recognize that people are different and babies are different and people may need different forms of accommodation.
  Modified duty policies help chairs to provide accommodations.
• Engage in work and family conversations proactively. We found a lot of chairs were fearful to talk to pregnant female faculty in their department about taking leaves. Letting people know about policies and their use requires conversation.
• Review policies and practices and repeat often to make sure they are relevant, up to date, and effective.

Department Level Recommendations

Departments matter -- they set the culture and climate for faculty. The department is really the most important place at an institution because this is where the work gets done and this is where the review and evaluation process is most intense. Department chairs set the tone with their colleagues about policy. Senior men and women colleagues also play a prominent role in the review process and in creating an open environment. A positive work/family culture starts at the department level. One of the things we learned is that departments (and institutions) need to think about faculty needs and how they vary throughout the career. A lot of time, energy and policy are focused on pre-tenure faculty, but departments should think about how to support their faculty throughout the career. If we want women to progress in their career the focus needs to be holistic and on-going and not just end once people get tenure.

Individual Level Recommendations

The primary focus for people trying to get established as professors is timing. We often get asked, "When should I have a baby?" And we respond, "When you are ready." There is no right or wrong time to have a baby. It's also not a decision that is easily controlled (contrary to popular belief). So that is our first piece of advice. Once people have a child and are in a faculty job we offer the following bits of advice,
• Ask for what you need.
• Find allies and support.
• Do your work.
• Set reasonable priorities.
• Manage time wisely and efficiently.
• Plan and anticipate.
• Be a good colleague.
• Pay it forward.
• Take a life-course perspective -- you won't always be "junior" and your children won't always be babies.

We want to stress that if you want a child and an academic career, it is doable and there is joy in the job and in parenting. There are women doing it every day who make it work in different institutional types and different disciplines. If you want to have a baby and an academic career you can do both and be happy and productive and sane.

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1258 Can Faculty Misinterpretation and Misuse of Student Rating Results Lead to the “Dumbing Down” of College Education?

Many faculty members believe that SRIs (student ratings of instruction) measure instructor expressiveness or style rather than the substance or content of teaching. They argue that, “Most student rating schemes are nothing more than a popularity contest with the warm, friendly, humorous instructor emerging as the winner every time” (Aleamoni, 1999, p.154).
-----------------------------------------------------------------------------------------------------------------

"Desktop faculty development 100 times per year."
Over 49,000 subscribers at over 850 institutions in more than 100 countries

TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER

Archives of all past postings can be found at:

Sponsored by
Stanford Center for Teaching and Learning

Check out the Tomorrow's Professor Blog at:

Folks:

The posting below presents faculty beliefs that they can lower the standards of teaching in a course to get higher ratings by students, as well as established research results that refute these beliefs. It is from Chapter 3: SRI Validity—Teacher Controllable Biasing Factors? in the book, Student Ratings of Instruction: Recognizing Effective Teaching, by Nira Hativa, foreword by Christine Stanley at A&M University. Information about the book and pricing in https://www.createspace.com/4065507 or at amazon.com and Amazon Europe. ISBN : 978-1481054119. Copyrights © by Oron Publications. All rights reserved. Reprinted with permission.

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: Motherhood: How Faculty Manage Work and Family

Tomorrow's Teaching and Learning

-------------------------------------------------------------- 1,936 words -----------------------------------------------------------------

Can Faculty Misinterpretation and Misuse of Student Rating Results Lead to the “Dumbing Down” of College Education?

Over the last few decades, a considerable body of research, commentary, criticism, and concerns has focused on issues related to the reliability and validity of student ratings of instruction (SRI). Despite impressive research support of SRI reliability and validity, unsubstantiated claims of potential biases continue to flourish and to be believed by faculty. Every so often, a study claims to have identified factors proven to bias SRI results whereas a large body of research evidence refutes these allegations.

Bias of SRI validity “exists when a student, teacher, or course characteristic affects the evaluations made, either positively or negatively, but is unrelated to any criteria of good teaching, such as increased student learning” (Centra, 2003, p. 498). Thus, in order to establish a factor as biasing SRI validity, it should satisfy two conditions:

1.     It should show significant relationships with, or have effect on, results of SRIs; and

2.     It should not relate to quality of teaching or to promoting student learning.

Some extraneous factors that have been accused of biasing SRI results are: For the instructor: academic rank, teaching experience, personal characteristics, physical attractiveness, research productivity, and having an Asian accent; For the student: year in college, and personality; For the instructor and student: age, gender, race, ethnicity, nationality, and other diversity issues; For the course—the time of day it is offered, the number of rows in the classroom, and length of class meetings. However, established research shows most consistently (see Chapter 4) that none of these factors satisfies the two conditions as above (Centra, 2008; Remedios & Lieberman, 2008). In some cases, the studies identifying these biasing factors may have significant deficiencies.

This chapter examines relationships between student ratings and several factors that teachers can control. Faculty who believe that these factors can be manipulated to increase instructor ratings while not improving teaching or learning (that is, that they bias SRI validity) may adopt undesired teaching behaviors that would lead to damaging consequences.

Does instructor popularity/expressiveness/enthusiasm bias SRI validity?

Many faculty members believe that SRIs measure instructor expressiveness or style rather than the substance or content of teaching. They argue that “Most student rating schemes are nothing more than a popularity contest with the warm, friendly, humorous instructor emerging as the winner every time” (Aleamoni, 1999, p.154).

Indeed, interesting and engaging presentations are highly correlated with student ratings of Overall Teaching (Feldman, 2007; Hativa, 1999; 2008; Hativa, Barak & Simhi, 2001) but they are by no means the sole explanation of high ratings. Aleamoni (1999) found that students praised instructors for their warm, friendly, humorous manner in the classroom but frankly criticized them if their courses were not well organized or their methods of stimulating students to learn were deficient.

Expressive instructors may also receive higher ratings because their expressiveness stimulates and maintains student attention and thus helps students learn. Furthermore, expressiveness includes a range of specific behaviors related to good lecturing, such as speaking emphatically, using humor, and moving around during the lecture. Trained observers have found that highly rated faculty exhibit these behaviors more frequently than other faculty (Murray, 2007).

In sum, even if the factor popularity/expressiveness/enthusiasm is found to soundly correlate with student ratings, research evidence indicates that it tends to enhance learning and therefore cannot be considered a biasing factor (Cashin, 1995; Gravestock & Gregor-Greenleaf, 2008).

Does perceived course difficulty/workload bias SRI validity?

In almost all SRI studies, the level of course difficulty or workload is established not by direct measurement of actual difficulty or workload, but rather by student ratings of relevant questionnaire items. Thus, the accurate title for the factor “course difficulty/workload” should be “perceived course difficulty” or “perceived workload”.

Many faculty members are concerned that perceived course difficulty/workload substantially affect student ratings and thus bias SRI results. They believe that there is an inverse relationship between difficulty/workload and ratings on Overall Teaching, that is, the easier and the less demanding the course, the higher the rating on Overall Teaching. Nonetheless, the large majority of studies that examined this issue found almost zero (or very small and non-significant) correlations between course difficulty/workload and teacher ratings, that is, almost no relationships (Cohen, 1981; Marsh and Dunkin, 1997).

In summary, perceived course difficulty/workload shows almost no relationship or only weak relationship with teacher ratings so that it does not bias SRI results.

Do expected grades bias SRI validity?

Many faculty members strongly believe that students tend to rate them more highly when they expect to receive good grades, and that low ratings might reflect students’ retribution for low grades (Aleamoni, 1999; Beran, Violato, Kline, & Frideres, 2005). Marsh (1987) found that over two thirds of faculty members hold this belief.

We should note that “grades” in SRI studies usually refer to expected grades—those that students expect to receive based on their performance to the day of SRI administration, and sometimes on the instructor’s cues, or on rumors from students of previous offerings of the same course. “Grades” do not refer usually to actual grades because teacher ratings are generally administered during the last few weeks of the term, before students take the final exam and receive their actual grades.

A few studies (Greenwald & Gillmore, 1997; Wachtel, 1998) indeed found a direct relationship between expectations of high grades and positive teacher evaluations. They interpreted this as a clear indication that students reward instructors for lenient grading by increasing their ratings, and thus that grading leniency may bias SRI results. A different possible interpretation is that even if some positive expected grade-SRI correlations are identified, they may reflect a positive effect of expecting high grades on encouraging students to work harder and learn more. Students with these expectations may learn better and would rate the course and teacher highly (Centra, 2003; Feldman, 2007; Marsh & Roche, 2000; Wachtel, 1998). However, the large majority of studies on this issue (e.g., Abrami, 2001; Centra, 2003; Marsh & Roche, 2000; Theall, Franklin, & Ludlow, 1990) deny the existence of such relationships, showing that correlations between expected grades and instructor ratings are very small, almost zero.

Altogether, student expected grades and grading leniency are not biasing factors of SRI validity.

Do actual grades bias SRI results?

Because SRIs are usually administered before the final exams take place and grades are assigned, only few studies examined relationships between students’ ratings of their teacher and their actual final grades in that course. In studies that did use actual grades, the researchers gathered them at some later point in time. These studies show a very small and non-significant positive association between average class grades and teacher ratings.

Similar to the discussion above on expected grades, even if a small positive association is identified in some studies, it would not indicate bias of the ratings’ validity. Positive associations may well indicate that good teachers, those who help their students learn the most and consequently to do well on course exams, tend to be rated highly by their students. In this case, both the higher grades of students and the higher ratings of teachers are well deserved (Feldman, 1976).

All in all, student actual grades do not bias SRI validity.

Can students be manipulated to give faculty higher ratings?

The most popular beliefs among faculty are that they can “buy” higher ratings by lowering course requirements, that is, that “bribing” students by entertaining them, watering-down the course material, reducing difficulty/workload, and giving undeserved high grades will translate into higher student ratings (Franklin & Theall, 1991; Heckert, Latier, Ringwald-Burton, & Drazen, 2006; Marsh & Roche, 2000). Of the large number of faculty SRI-related beliefs, these are probably the most potentially damaging, because they may lead faculty to resort to counter-productive teaching strategies. Faculty may be tempted to grade higher and to lower the level of difficulty/workload in order to receive higher ratings from students (Centra, 2003). This, in turn, may lead to grade inflation and to a decline in the amount of effort that students put into their courses. The ultimate consequence could be the “dumbing down” of college education (Greenwald & Gillmore, 1997). Here are some examples for dumbing down course content:

     Building the subject slowly from the bottom up, giving lots of examples in class, dropping topics from the syllabus when convenient,
     and using homework problems as ‘models’ for exam problems (Zucker, 2010, p. 821).

There is some evidence that these damaging behaviors have already been adopted by certain instructors:

     This performance measurement has lead to both unethical grade inflation and coursework deflation as faculty try to entertain students
     rather than educating them… instructors ease grading, inflate grades and deflate course work when SET data is used for faculty
     evaluation purposes. By inflating grades, easing grades, and deflating coursework, an instructor games the system and thus, is more
     likely to receive positive evaluations (Crumbley et al., 2010, pp. 187-8).

Although many sources have discounted the likelihood of grade inflation resulting from instructors trying to ‘buy’ better student ratings of instruction, many faculty members still believe that there is widespread manipulation of grades (Franklin & Theall, 1991, p. 1). There is a negative ethical aspect to manipulating situations and students in order to raise ratings. However, one cannot blame SRIs if the real issue/problem is unethical teacher behavior.

The ironic point is that most of these manipulative behaviors have not proven effective in raising teacher ratings as shown below, but nonetheless they continue to be tried out by instructors. The assumption underlying these behaviors is that many students strive for high grades with easy course demands and a low workload. However, research does not support the generality of this belief and on the contrary, there is almost a consensus among experts refuting faculty beliefs about all types of manipulation, as next explained.

Can manipulating difficulty/workload level increase faculty ratings?

Workloads that students perceive as excessive may indeed negatively affect their learning. Overloaded students may develop feelings of stress and failure and adopt unhelpful learning strategies. However, contrary to faculty beliefs that decreasing difficulty/workload will increase their ratings, research evidence shows that if success is too easily achieved as a result of an overly light workload, students may lose interest and devalue such learning. Courses demanding the least amount of work tend to receive lower, rather than higher ratings. Students tend to value learning and achievement more highly when they involve a substantial degree of challenge and commitment and require investing time and effort (Marsh & Roche, 2000). Students seem to appreciate a workload that is of the right magnitude but is still sensible and presents a challenge. Courses for which students indicated that the level of difficulty or the workload was appropriate or that they had expended more efforts, were rated higher than other courses. The more effort expended, the higher students perceived the value of the course (Heckert et al., 2006; Marsh & Roche, 2000).

Can manipulating grades’ level increase faculty ratings?

Students are not as likely to be positively affected if an ineffective teacher seems to be trying to buy good ratings with easy grades. In fact, the attempt may boomerang (McKeachie, 1997). McKeachie brings as an example a faculty member whose grades were the highest in his department but who received the lowest student ratings. Assigning undeserved higher grades to students may have a negative effect on instructor ratings (Abrami, Dickens, Perry, & Leventhal, 1980). However, the assumption that giving higher grades can raise ratings may be correct if the instructor can convince students that they have learned more than is typical and therefore they deserve the higher grades.

Abrami, P. C. (2001). Improving judgments about teaching effectiveness using teacher rating forms. In M. Theall, P. C. Abrami & L. A. Mets (Eds.), The student ratings debate: Are they valid? How can we best use them? New directions for institutional research (Vol. 109, pp. 59-87). San Francisco: Jossey-Bass.

Abrami, P. C., Dickens, W. J., Perry, R. P., & Leventhal, L. (1980). Do teacher standards for assigning grades affect student evaluations of instruction? Journal of Educational Psychology(72), 107-118.

Aleamoni, L. M. (1999). Student rating myths versus research facts from 1924 to 1998. Journal of Personnel Evaluation in Education, 13(2), 153-166.

Beran, T., Violato, C., Kline, D., & Frideres, J. (2005). The utility of student ratings of instruction for students, faculty, and administrators: A “consequential validity” study. Canadian Journal of Higher Education, 35(2), 49-70.

Cashin, W. E. (1995). Student ratings of teaching: The research revisited. IDEA Paper No. 32. Manhattan, KS: Kansas State University Center for Faculty Evaluation & Development.

Centra, J. A. (2003). Will teachers receive higher student evaluations by giving higher grades and less course work? Research in Higher Education, 44(5), 495-518.

Centra, J. A. (2008). Differences in student ratings of instruction: Is it bias? Paper presented at the 88th annual meeting of the American Educational Research Association, New York.

Cohen, P. A. (1981). Student-ratings of instruction and student-achievement - a meta-analysis of multisection validity studies. Review of Educational Research, 51(3), 281-309.

Crumbley, D. L., Flinn, R. E., & Reichelt, K. J. (2010). What is ethical about grade inflation and coursework deflation? Journal of Academic Ethics, 8(3), 187-197.

Feldman, K. A. (1976). Grades and college students' evaluations of their courses and teachers. Research in Higher Education, 4(1), 69-111.

Feldman, K. A. (2007). Identifying exemplary teachers and teaching: Evidence from student ratings In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 93-143). Dordrecht, The Netherlands: Springer.

Franklin, J., & Theall, M. (1991). Grade inflation and student ratings: A closer look. Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL.

Gravestock, P., & Gregor-Greenleaf, E. (2008). Student course evaluations: Research, models and trends. Toronto: Higher Education Quality Council of Ontario, from http://www.heqco.ca/SiteCollectionDocuments/Student Course Evaluations.pdf

Greenwald, A. G., & Gillmore, G. M. (1997). No pain, no gain? The importance of measuring course workload in student ratings of instruction. Journal of Educational Psychology, 89(4), 743-751.

Hativa, N. (1999). Towards a conceptual framework of dimensions of effective instruction: The role of high-intermediate-and low-inference teaching behaviors. Instructional Evaluation and Faculty Development, 18, 3-10. Retrieved from http://www.aera.net/Default.aspx?menu_id=168&id=914

Hativa, N. (2008). Lecturing for effective learning: Disc 1--Making lessons interesting. Sterling, VA: Stylus.

Hativa, N., Barak, R., & Simhi, E. (2001). Exemplary university teachers: Knowledge and beliefs regarding effective teaching dimensions and strategies. Journal of Higher Education, 72(6), 699-729.

Heckert, T. M., Latier, A., Ringwald-Burton, A., & Drazen, C. (2006). Relations among student effort, perceived class difficulty appropriateness, and student evaluations of teaching: Is it possible to" buy" better evaluations through lenient grading? College Student Journal, 40(3), 588.

Marsh, H. W. (1987). Students' evaluations of university teaching: Research findings, methodological issues, and directions for future research. International Journal of Educational Research, 11(3), 253-388.

Marsh, H. W., & Dunkin, M. J. (1997). Students' evaluations of university teaching: A multidimensional perspective. In R. P. Perry & J. C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 241-313). New York: Agathon Press.

Marsh, H. W., & Roche, L. A. (2000). Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology, 92(1), 202.

McKeachie, W. J. (1997). Student ratings: The validity of use. American Psychologist, 52(11), 1218-1225. Retrieved from http://psycnet.apa.org/journals/amp/52/11/1218.pdf

Remedios, R., & Lieberman, D. A. (2008). I liked your course because you taught me well: The influence of grades, workload, expectations and goals on students' evaluations of teaching. British Educational Research Journal, 34(1), 91-115.

Theall, M., Franklin, J., & Ludlow, L. (1990). Attributions and retributions: The locus of student ratings and perceptions of performance. Paper presented at the annual meeting of the American Educational Research Association, Boston: MA.

Wachtel, H. K. (1998). Student evaluation of college teaching effectiveness: A brief review. Assessment & Evaluation in Higher Education, 23(2), 191-212.

Zucker, S. (2010). Evaluation of our courses. [Opinion]. Notices of the AMS (August), 821.

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1257 Service vs. Serve-Us: What Will Your Legacy Be?

Learning how to balance service work among other commitments, duties, obligations, and responsibilities reflects personal and professional maturity.
-----------------------------------------------------------------------------------------------------------------

"Desktop faculty development 100 times per year."
Over 49,000 subscribers at over 850 institutions in more than 100 countries

TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER

Archives of all past postings can be found at:

Sponsored by
Stanford Center for Teaching and Learning

Check out the Tomorrow's Professor Blog at:

Folks:

The posting below looks at the importance of service work in our academic lives.  It is by Bradley J. Cardinal* and first appeared on April 30, 2013 in the Journal of Physical Education,Recreation & Dance (Vol. 84 No. 5 May/June 2013) published by Taylor & Francis Group, 325 Chestnut Street, Suite 800, Philadelphia, PA 19106 Tel: 215.606.4334, www.tandfonline.com. Reprinted with permission.

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: Can Faculty Misinterpretation and Misuse of Student Rating Results Lead to the “Dumbing Down” of College Education?

Tomorrow's Academic Careers

--------------------------------------------------- 1,633 words ------------------------------------------------------

Service vs. Serve-Us: What Will Your Legacy Be?

Imagine a job applicant asking the question, “If I come here, what is the least amount of service work I have to do to get by?” Or how would you feel if you were preparing to depart for a professional conference and a colleague said to you in passing: “You still go there? Why?” Or you are working with someone who volunteers to chair a committee but does nothing to advance the work of the group and is non-communicative and non-responsive when others attempt to communicate with her or him. Sadly, these are not make-believe scenarios. They are real-life experiences that I have witnessed during my own career. From talking with others, I suspect they are relatable and not necessarily the most egregious.

Is there a prevailing attitude of avoidance, disengagement, and entitlement brewing in our disciplines and professions? Are we socializing people—our students, our colleagues—to dismiss or neglect the service needs of our communities, institutions, and professional societies?

In this editorial, I draw attention to what I view as a diminishing “service” mindset and a growing “serve-us” mindset among people in our fields of study.Table 1 articulates the key differences between these typologies. In a nutshell, those with a “service” mindset voluntarily give of themselves for the betterment of others, whereas those with a “serve-us” mindset partake in activities reluctantly or participate in only those activities that result in a direct personal benefit to them (e.g., power, privilege, title).

Service and Society

Civic engagement, civility, and the interconnectivity among people in the United States hit a record low at the close of the 20th century, according to Bowling Alone: The Collapse and Revival of American Community (Putnam, 2000).

Eleven years after the publication of Putnam’s book, volunteerism rates in the United States were 26.8% (Corporation for National and Community Service, 2012). While this represents the highest rate of volunteerism seen in five years, it is still lower than the rates observed for all the years prior to 2006. Whether or not the 26.8% figure represents a bottoming out or reversal of the downward trend in volunteerism remains to be seen. Regardless, we are currently living with the consequences of a generation raised in an era of diminished volunteerism.

------------------------------------------------------------------------------------------------------
Table 1. Focus of a “Service” vs. “Serve-us” Mindset (Note: I have changed the format slightly to allow for e-mail posting - RR)

Focus              “Service”

Advice
                    We are all stewards of
                    something larger than ourselves.
                    Seek out authentic opportunities
                    to better humanity by contributing
                    to your community, institution,
                    profession, etc.

Approach 

                   Communal, cooperative, interdependent

Commitment          

                    Active, engaged, involved,
                    participates, volunteers

Contribution        

                    Puts into

Orientation         

                   Community, group, organization, others, selfless

Outcome/expectancy  

                    Doesn’t care who gets credit,
                    intrinsic, mutuality, satisfaction, win–win

Perspective        

                    Authentic, give, offer

Questions           

                   What can I do to help?

--------------------

Focus              “Serve-Us"

Advice              

                    Service doesn’t really
                    count for anything. Protect yourself
                    and your time above all else. Find out what
                    is the least amount of service required
                    of you and stick with that.

Approach            

                   Autonomous, competitive, individualistic

Commitment          

                     Avoids, disassociates, disingenuous, passive,
                     removed, waits to be asked

Contribution        

                     Takes from

Orientation        

                     Ego, me, selfish

Outcome/expectancy  Personal gain, contempt, extrinsic,
                    wants personal credit, win–lose

Perspective         

                    Receive, strategic, take

Questions           

                    What is in it for me?

------------------------------------------------------------------------------------------------------

This disengagement seems to extend to our professional work as well, in which service duties are often shirked and even basic things such as affiliation through membership remain low. For example, Buschner (2007) estimated that only 8% of physical education teachers employed in the United States are members of the National Association for Sport and Physical Education. Of those who do belong to professional societies, many are reluctant to volunteer their time or expertise to committee work, or to run for and serve in either elected offices or appointed positions (Asbell, 2007; Dowd, 2007).

Service Sustains

We are not socializing people to engage in or value service (Napper-Owen, 2012), and by not doing so, we are doing our charges and pledges a disservice, harming our fields of study, and depriving the communities, institutions, and organizations that we live in, work for, and affiliate with of our time and expertise. The scenarios highlighted in the opening paragraph are indicative of this. Service work is often described as a colossal waste of time, an unrewarded chore, and something to protect oneself from—especially early on in one’s career (GMP, 2010). Even if well intentioned on some level, encouraging this perspective or suggesting that others take this approach to life and work does more harm than good. If service work is desirable or eventually expected, necessary, and/ or required of a person after a probationary period of time, then it only makes sense to socialize people to engage in service work early in their careers. Learning how to balance service work among other commitments, duties, obligations, and responsibilities reflects personal and professional maturity.

Additionally, authentic service work has a multitude of psychological and sociological benefits (e.g., affiliation, belonging, interpersonal skill enhancement, knowledge acquisition, loyalty, networking, outreach, understanding, visibility). It is also associated with living a longer, healthier, and more satisfying life (Okun, August, Rook, & Newsom, 2010). However, there is an interesting catch to this. The service rendered must be for other-oriented reasons (“service”) rather than personal gain reasons (“serve-us”) for the benefits to hold true (Konrath, Fuhrel-Forbis, Lou, & Brown, 2012).

It’s Not All Fun and Games

Now, before being accused of glorifying service work to the detriment of one’s own personal life or professional career, let me also be clear that service work can at times be daunting, frustrating, and time consuming. For this reason it is important to make certain that the service assignments accepted or pursued are authentic, meaningful, and personally relevant. As the muse Kira, played by Olivia Newton-John in the movie Xanadu, said, “It must be frustrating to waste your talents on things that don’t really matter to you” (Danus, Rubel, & Greenwald, 1980).

Of course, there are core functions that go along with any service assignment, and sometimes these are not glamorous— perhaps akin to cleaning your house. Indeed, such tasks may go unnoticed when done well, but if not done or done poorly, people will notice. Therefore, it is important to be attentive, caring, and responsive to the core functions of any service assignment assumed. Doing so reflects one’s dependability, humility, and level of responsibility. And people notice this, too. If you cannot give something the effort that it deserves, then it is better to pass on the assignment in the first place. Attempting to do something that your heart is not in or that you truly do not have time for creates more work for others and deprives other people of opportunities, and it can tarnish your reputation. Knowing when and how to say “no” is also a sign of personal and professional maturity. If you are interested, but the timing is not right, let people know that, too.

Our Service Realities Vary

The context of each of our lives is different.The needs of our communities, work environments, and the professional societies we belong to are unique.The expectations placed upon us and others vary as well. For example, women and minorities are often over-burdened with service duties while other groups do comparatively little, or when they do serve, they take on the larger and more visible roles (Massé & Hogan, 2010). It would be easy to dismiss this as a simple timing issue; however, the unique interplay among gender, ethnicity, race, and sexual orientation in relation to our service realities are difficult to disentangle.This is something of which to be mindful and attentive.

Cynicism sometimes becomes associated with service work, too. Those who serve must not be doing something else. Or, those who serve do it to compensate for other areas of weakness or because it is an accessible way to contribute. Of course, such assumptions are biased and fraught with prejudice. Conversely, some question the point of serving if their time and efforts are in vain or the results futile. For example, sometimes committee accomplishments go nowhere or are superseded by administrative decisions. When this happens, it counteracts the finding of meaning in service, which can result in mistrust and disengagement.

One result of our growing and, at times, fragmented fields of study is that there are infinite demands and needs for our services. A biomechanist may judge a science fair, a dance educator may help write state dance standards, a physical educator may testify to state legislators, a sport psychologist may consult with a team, and so on. There are more journals, requiring more editorial services; and more professional organizations needing to fill their boards and committees with devoted and dedicated professionals. Moreover, greater expectations, accountability, and documentation are required in the work we do.That said, service work remains important to the long-term success of any community, institution, or professional society.

Take-Home Message

Like mortar between bricks, service is paramount to stabilizing and sustaining our structures. It is also the intersecting point between all the bricks. The bricks sit in isolation, separated from one another by the mortar. The bricks need the mortar, and the mortar needs the bricks.They are interdependent; the presence of one without the other results in structural instability and weakness.

People should be encouraged to assume service assignments, rather than discouraged from doing so. Approaching life with a service-oriented spirit and participating in authentic service-oriented activities is reflective of a life well lived. As a reminder of this, one of Coach John Wooden’s favorite maxims was, “Be more concerned with what you can do for others than what others can do for you. You’ll be surprised at the results” (Wooden & Jamison, 1997, p. 200).

References

Asbell, A. C. (2007, Fall). Volunteering – What it means – Where has it gone? Oregon Association for Health, Physical Education, Recreation and Dance Journal, 12–13.

Buschner, C. (2007). Peak professionalism. California Association for Health, Physical Education, Recreation and Dance Journal, 70(1), 13–14, 24.

Corporation for National and Community Service. (2012, December). Volunteering and civic life in America 2012: Key findings on the volunteer participation and civic health of the nation. Washington, DC: Author. Retrieved from http:// www.volunteeringinamerica.gov/ assets/resources/FactSheetFinal.pdf.

Danus, R. C., Rubel, M. R. (Writers), & Greenwald, R. (Director). (1980). Xanadu [Motion picture]. United States: Universal Studios.

Dowd, K. J. (2007). Involved in your profession and making a difference. California Association for Health, Physical Education, Recreation and Dance Journal, 70(1), 11–12.

GMP. (2010, June 18). Serves you right. Inside Higher Ed. Retrieved from http://www.insidehighered. com/advice/jungle/jungle1.

Konrath, S., Fuhrel-Forbis, A., Lou, A., & Brown, S. (2012). Motives for volunteering are associated with mortality risk in older adults. Health Psychology, 31, 87–96.

Massé, M. A., & Hogan, K. J. (Eds.). (2010). Over ten million served: Gendered service in language and, literature workplaces. Albany, NY: State University of NewYork Press.

Napper-Owen, G. (2012). Raising the next generation. Quest, 64, 131–140.

Okun, M. A., August, K. J., Rook, K. S., & Newsom, J.T. (2010). Does volunteering moderate the relation between functional limitations and mortality? Social Science and Medi- cine, 71, 1662–1668.

Putnam, R. D. (2000). Bowling alone:
The collapse and revival of Ameri- can community. NewYork: Simon & Schuster.

Wooden, J. R., & Jamison, S. (1997).
Wooden: A lifetime of observa- tions and reflections on and off the court. Lincolnwood, IL: Contempo- rary Books.

Bradley        J.Cardinal(brad. cardinal@oregonstate.edu) is a professor in the College of Public Health and Human Sciences, School of Biological and Population Health Sciences, Program in Exercise and Sport Science, at Oregon State University in Corvallis, OR.

--------------
* Bradley J. Cardinal, Ph.D. Professor, Social Psychology of Physical Activity Co-Director, Sport and Exercise Psychology Lab Program in Exercise and Sport Science School of Biological and Population Health Sciences College of Public Health and Human Sciences
Oregon State University, Corvallis, OR 97331-3303

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1256 Teaching Quantitative Reasoning

In today’s data-rich world, the importance of QR skills will only grow, yet these courses can be difficult to teach. If you’re interested in learning more approaches, consider visiting the National Numeracy Network, Carleton’s QuIRK Initiative, Statlit, or SIGMAA-QL. These organizations provide a wide array of resources for faculty looking to enhance their QR pedagogy. 
-----------------------------------------------------------------------------------------------------------------

"Desktop faculty development 100 times per year."
Over 49,000 subscribers at over 850 institutions in more than 100 countries

TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER

Archives of all past postings can be found at:

Sponsored by
Stanford Center for Teaching and Learning

Check out the Tomorrow's Professor Blog at:

Folks:

The posting below looks at ways to improve students' quantitative reasoning skills.  It is by Mary Wright* and Joe Howard*, and is adapted from a Center for Research on Learning and Teaching, University of Michigan, Ann Arbor, MI, blog post (http://feeds.feedburner.com/CRLT_blog), April 5, 2013. © 2012 The Regents of the University of Michigan. Reprinted with permission.

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: Service vs. Serve-Us: What Will Your Legacy Be?

Tomorrow's Teaching and Learning

---------------------------------------------------------------- 939 words ----------------------------------------------------------------

Teaching Quantitative Reasoning 

Whether mathematically inclined or not, today’s college graduates will be expected to “navigate a sea of numbers on a daily basis” in their careers and daily lives (Grawe, 2012, p. 30). A majority of employers interviewed in a recent study noted that they want universities to enhance their quantitative reasoning (QR) skills, or students' ability to work with numbers and understand statistics (Hart Research Associates, 2009). Key competencies embedded in QR include (Dwyer, Gallagher, Levin & Morely, 2003; Rhodes, 2009; Wolfe, 1993):

· The ability to make sense of information displayed in a number of formats (graphs, tables, diagrams, equations) and to convert information from one
  format to another.

· Competency in mathematical calculation.

· The use of evidence in drawing conclusions about numerical data and the ability to assess the limitations of the evidence.

· The ability to describe and evaluate assumptions for estimation, data analysis, and modeling.

Many schools and colleges have some curricular QR requirement to help students build these skills. What teaching strategies are working best in such courses? In 2009, the Center for Research on Learning and Teaching, at the University of Michigan (U-M), collaborated with the College of the Literature, Science, and Arts to assess its QR requirement. The assessment findings were based on a study of nearly 2,000 students (Wright & Barber, 2009). After the 2009 assessment, CRLT staff conducted follow-up discussions with U-M instructors about the findings and their own teaching approaches.

These discussions indicate that many faculty are maximizing student learning by using strategies that research has proven effective for strengthening students' QR skills. Here are some examples:

· Use active note-taking to promote problem-solving skills : Brenda Gunderson, in U-M's Department of Statistics, uses a customized notepack with equations, definitions, and “Try It!” problems. Therefore, students do not need to spend time writing down equations or definitions, and Dr. Gunderson can instead engage students in problem-solving throughout the lecture. In addition, Gunderson uses a personal response system (iClickers) to scaffold difficult questions with peer discussion. Doing so, she notes, “mandates a sense of engagement” among her more than 1700 students.

· Provide multiple assessment opportunities with feedback : Research tells us that multiple opportunities for student assessment – when paired with instructor feedback – foster a rich learning environment. In the Communication Studies course, "Evaluating Information," Michael Traugott and Nick Valentino have assigned weekly quizzes, along with multiple papers and exams scattered throughout the semester. Assignments occurring later in the term are weighted more heavily, allowing students the opportunity to make mistakes as they grow in confidence and capability. Professor Ed Rothman, in "Statistical Principles for Problem Solving: A Systems Approach," assigns 14 memos in which students must apply a statistical concept to a real-life situation. Some memo assignments require the student to orally defend their reasoning to Rothman, allowing the student the opportunity to receive feedback and suggestions for improving future memos.

· Capitalize on collaborative learning opportunities : Collaborative learning is one key educational practice that has been shown to increase student engagement and retention (Rhodes, 2010; Treisman, 1992) . In U-M's Calculus I, nearly all of the instruction is orientated to group problem-solving. Student gains on the Calculus Concept Inventory for U-M are significantly higher compared to calculus courses at 25 other colleges and universities, suggesting the approach is particularly effective ( Calculus Concept Inventory, 2009) .

· Use real-world problems: Despite strong research findings that this is an effective technique for teaching QR, the 2009 U-M assessment found that many LSA students did not perceive that their instructors were using (or effectively using) "real-world problem solving" in their courses. However, there are several examples of successful incorporation of such practices. For instance, Brian Arbic, a U-M professor in Earth and Environmental Sciences, incorporates problems based on issues studied by oceanographers into his “Introductory Oceanography” course. Students are encouraged to bring laptops to class, and they work in teams on questions, such as how long it would have taken for the 2004 tsunami to travel from its source in Indonesia to given points on the Indian and African coasts.

The scholarship on student learning provides many additional examples of faculty teaching QR through real-world problems, from multiple disciplinary perspectives:

* Schield (2008) developed and uses a 10-element model to help students dissect current news stories which contain statistical information in a course titled “Quantitative Reasoning and Statistical Literacy.”
    
* Atkinson and colleagues (2006) use real-world data in their introductory sociology course at North Carolina State University. Students analyze recent population studies to unearth sociological “knowns” such as income disparity and its relationship to education, gender, and race.
    
* In his history course at Miami University, Gene Metcalf has students research and mock-up a full scale floor plan of a typical Puritan house (using masking tape on the floor). In doing so, students come to learn that the average six-person family lived in a space of about 300 square feet, prompting discussions about the cultural implications of these factors. According to Metcalf, the exercise “gave them a better feel for life in a Puritan community and the relationship between the material world and culture” (Wolfe, 1993, p. 6).

In today’s data-rich world, the importance of QR skills will only grow, yet these courses can be difficult to teach. If you’re interested in learning more approaches, consider visiting the National Numeracy Network, Carleton’s QuIRK Initiative, Statlit, or SIGMAA-QL. These organizations provide a wide array of resources for faculty looking to enhance their QR pedagogy.

Thanks to Jim Barber, College of William and Mary; Allyson Bregman, City University of New York, and Theresa Braunschneider, CRLT, for their assistance with this project.

References

Atkinson, M. P., Czaja R. F., & Brewster, Z. W. (2006). Integrating sociological research into large introductory courses: Learning content and increasing quantitative literacy. Teaching Sociology, 34 (1), 54-64.

“Calculus Concept Inventory.” (2009). ContinuUM , University of Michigan Department of Mathematics Newsletter: 6.

Dwyer, C. A., Gallagher, A., Levin, J., Morley, M. E. (2003). What is quantitative reasoning? Defining the construct for assessment purposes . Princeton, NJ: Educational Testing Service.

Grawe, N. D. (2012, Spring). Achieving a quantitative literate society: Resources and community to support national change. Liberal Education : 30-35.

Hart Research Associates. (2009). Raising the bar: Employers’ views on college learning in the wake of the economic downturn . A survey of employers collected on behalf of the Association of American Colleges and Universities. Washington, DC: Hart Research Associates.

Rhodes, T., Ed. (2010). Assessing outcomes and improving achievement: Tips and tools for using rubrics . Washington, DC: Association of American Colleges and Universities.

Schield, M. (2008). Analyzing numbers in the news: A critical-thinking structured approach . Unpublished paper presented at the National Numeracy Network Conference, New London, NH.

Treisman, U. (1992). Studying students studying calculus: A look At the lives of minority mathematics students. College Mathematics Journal, 23 (5), 362-372.

Wolfe, C. R. (1993, Winter). Quantitative reasoning across a college curriculum . College Teaching, 41 (1), 3-9.

Wright, M.C., & Barber, J. (2009). LSA quantitative reasoning assessment: Summary findings . Available: http://www.crlt.umich.edu/assessment/lsaqrassessment
--

*Mary Wright, PhD, Director of Assessment and Associate Research Scientist , Center for Research on Learning and Teaching (CRLT) , University of Michigan , Ann Arbor, MI. 48109-2218 <mcwright@umich.edu>

* Joe Howard, Ph.D. student, Center for the Study of Higher and Postsecondary Education, University of Michigan

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.

TP Msg. #1255 Do iPads Affect Reading Comprehension and Learning?: The Jury Remains Out

Participants who used an iPad exhibited significantly higher transfer learning scores compared to traditional textbook readers. Gertner found that those who used an iPad scored higher on transfer learning than those using a traditional text. Gertner suggests that the integration of multimedia elements (i.e., the organization and presentation of content) may lead to greater gains on transfer learning scores.
-----------------------------------------------------------------------------------------------------------------
"Desktop faculty development 100 times per year."
Over 49,000 subscribers at over 850 institutions in more than 100 countries
TOMORROW'S PROFESSOR(sm) eMAIL NEWSLETTER
Archives of all past postings can be found at:
Sponsored by
Stanford Center for Teaching and Learning
Check out the Tomorrow's Professor Blog at:

Folks:

The posting below looks at a study that compared various kinds of reading comprehension using an iPad vs a traditional textbook. It is prepared by the Research and Evaluation Team, Office of Information Technology,(http://www.oit.umn.edu/research-evaluation/). University of Minnesota - Twin Cities. http://z.umn.edu/research. In an effort to make research in the educational technology field more accessible, OIT's Research & Evaluation team produces frequent brief synopses of important recent studies. These synopses may be freely shared and used for non-profit academic purposes. http://z.umn.edu/briefs. For further information contact Dr. J.D. Walker (jdwalker@umn.edu).

Regards,

Rick Reis
reis@stanford.edu
UP NEXT: Teaching Quantitative Reasoning

Tomorrow's Teaching and Learning 
--------------------------------------------- 1,082 words ---------------------------------------------
Do iPads Affect Reading Comprehension and Learning?:  The Jury Remains Out

“Always-on,” Internet capable mobile devices such as smartphones and tablet devices (for example, iPads), are increasingly prevalent at institutions of higher education (IHEs). While the popularity of the devices is undisputed, questions remain regarding the effects of such devices on learning in higher education. Abilene Christian University’s (ACU)[http://www.acu.edu/] “iPad Studies” [http://www.acu.edu/technology/mobilelearning/research/ipad-studies.html] are examples of an IHE conducting research on the effects of mobile devices on learning. A recent study by Gertner [http://www.acu.edu/technology/mobilelearning/documents/research/effects-of-technology-on-learning.pdf] examined the use of the iPad as a multimedia device and its effectiveness as a means of improving reading comprehension and transfer learning.

Study Design

Gertner employed two separate theoretical constructs in his study. The first was Cognitive Theory of Mulitmedia Learning (CTML), which states cognitive visual overload is troublesome for learners. However, when visual content appears in tandem with verbal cues (e.g., narration) cognitive overload is reduced, thus increasing the potential for a learner to perform tasks more effectively. Transfer theory, the second construct utilized by Gertner, is defined as “the effect of prior learning on new learning or performance” (Mayer, 2011). For example, if one knows the functions of parts of an automobile engine, one might better be able to diagnose and solve problems related to engine performance. Both of these theories support Gertner’s hypothesis that comprehension and transfer would be higher for those using an iPad.

To test these hypotheses, Gertner randomly assigned 69 participants from an Introductory Psychology class at ACU to read a chapter from a course text using an iPad with an e-reader app (n=25) or a traditional textbook (n=44). Gertner gave the participants a comprehension and transfer test following the reading session. The main points from Gertner’s study follow.

Findings

1. Participants who used an iPad did not score higher on reading comprehension than participants who used traditional textbooks. Gertner found no statistically significant difference in reading comprehension between the groups (iPad versus traditional text). He concluded those using an iPad performed comparably to those with a traditional text (more on this claim Discussion & Critique, below).

2. Participants who used an iPad exhibited significantly higher transfer learning scores compared to traditional textbook readers. Gertner found that those who used an iPad scored higher on transfer learning than those using a traditional text. Gertner suggests that the integration of multimedia elements (i.e., the organization and presentation of content) may lead to greater gains on transfer learning scores.

Discussion

Study Design.

* Random Assignment of participants. Participants were divided into two separate groups: one group using traditional textbooks and another group using iPad e-text books. Random assignment of participants can be challenging to execute, so this aspect of Gertner’s design makes it truly experimental. Such designs are not common in higher education research.

* Instrument Validation. Gertner noted assessment measures were not validated prior to the study. This is highly problematic due to the fact Gertner’s instruments might not be measuring what he claims to measure (in this case, comprehension and/or learning). This threat to the internal validity of the study, termed “instrumentation,” creates the possibility that any differences between the two groups are simply an artifact of the tool being used to evaluate any of the outcomes.
    
* Non-blind scoring. Gertner stated he knew which participants were in each group (iPad or traditional). As such, this knowledge may easily have biased the results of the study. In addition to bias, reliability becomes a concern as well. These are especially important points to consider since Gertner was the sole scorer of the assessment measures.

* Pretest for academic ability. Due to the study’s design, we do not know whether the effects of the device were really that of the device or another factor. It could be those in the iPad group had higher cognitive abilities to begin with and thus would perform better on the learning or comprehension test. If the sample size were larger, then chances increase for statistical equivalency between the two groups (due to random assignment) would be better, thus eliminating the need for a pretest. However, because no controls or pretest were in place, it is difficult to conclude whether the transfer learning (or reading comprehension) was due to the iPad and not an artifact of some other factor, such as differing academic ability.

* Selection of ANOVA for post-hoc analysis. Although the use of a one-way ANOVA in this study was appropriate, the author could have done more with his analyses. For example, although Gertner collected participant demographic data, he did not include these data in his analyses.  It would be useful to explore these data in post-hoc analyses to determine if any differences exist by gender, race, etcetera, within the groups.  Such analyses would offer the reader more specific information about the effects of mobile devices on learning outcomes. Moreover, it would allow the researcher to provide more precise recommendations to higher education constituents based on his findings.  

Critique

Regarding the first finding, Gertner suggested that while there were no statistically significant differences between groups on reading comprehension scores among those using iPads, they are at least comparable to traditional textbooks. While that is not an inappropriate statement, he goes on to conclude, “This trend in the data is favorable to those who advocate greater e-text usage in educational settings” (p. 27).  This also overstates the case and makes a claim that is unsupported by the data (i.e., this is a single study and that does not demarcate a ‘trend’ of any kind towards the efficacy of increased usage). Given the threats to internal and external validity of Gertner’s study, extreme caution should be utilized in concluding that these findings are generalizable to other populations.  This link is somewhat misleading, as comparability does not necessarily lead to favorability.

Regarding the second finding, Gertner speculated that the reason participants scored higher using the iPad than traditional text was perhaps due to the functionality of the iPad (e.g., appearance of content, key word searchability) and the way content appeared on the iPad. This may be true; however, due to the lack of any evidence to support this assertion, it is difficult to determine whether this claim has merit.
 
Conclusions

A (very) cautious step. While Gertner’s study contains some methodological shortcomings, his study is important, as it opens the conversation for further investigation into the use of mobile devices and important student learning outcomes. That said, future studies should carefully adhere to more rigorously focused and controlled methodologies in an effort to provide more systematic, valid, and generalizable (i.e., tangible) results.

References

Gertner, R. (2012). The Effects of Multimedia Technology on Learning, (Unpublished Master’s Thesis).[http://www.acu.edu/technology/mobilelearning/documents/research/effects-of-technology-on-learning.pdf]  Abilene Christian University.

Mayer, R. E. (2011). Applying the science of learning. Boston, MA: Pearson.

* * * * * * *
NOTE: Anyone can SUBSCRIBE to the Tomorrows-Professor Mailing List by going to:
https://mailman.stanford.edu/mailman/listinfo/tomorrows-professor

You can UNSUBSCRIBE by hitting "return" to this posting with the word "unsubscribe" in the subject line.