Last summer I wrote a brief post about access to scholarship in a MOOC co-taught by Tom Sanchez, Professor in Urban Affairs and Planning, shortly after the course’s initial offering. After TechniCity was offered again this past spring, I thought I would ask Tom more questions about the course. Read more…
Several participants of the TechniCity MOOC have asked for the raw data of comments and other activity from the MindMixer discussion forum. An Excel file of all activity is now available for download here.
Please be sure to share the results of your analyses with the rest of us and post on Twitter using #technicity or on the TechniCity LinkedIn page.
At the end of 2013, I posted an initial citation analysis for urban planning academics using Google Scholar citations (see: bit.ly/1lNyHR8). I also emailed the individual data to each of the faculty included in the analysis to get their feedback. I would like to thank everyone who responded confirming or correcting their information, as well as those providing comments and suggestions. The results below summarize a more complete analysis that is being prepared for publication. There are a few things I would like to mention, each being discussed in much more detail in a forthcoming article.
- The previous analysis was based on the 2011 ACSP Guide to Undergraduate and Graduate Education in Urban and Regional Planning. This analysis uses the 2013 Guide (19th Edition). All schools and regular faculty (i.e., tenure track) in the Guide are included.
- Citation analysis is one of several ways to gauge faculty productivity and impact. Teaching, service, funded research, etc. are other facets of what we do, but are not accounted for. Therefore scholarly publication is the focus here.
- Google Scholar citation counts (as of March – May 2014) were used for the analysis. There is some debate about the accuracy of Google Scholar versus Scopus or Web of Science, about which I will provide a complete discussion in an upcoming publication.
- Traditional citation analysis includes books, chapters, and journal articles – materials commonly controlled by publishers. The nature of “citations” is changing and Google Scholar reflects this by including some non-traditional citation types. I argue Google Scholar is quite appropriate for the field of planning. (See an earlier discussion in my paper from the Journal of the World Universities Forum).
- School/program rankings are based on median values (instead of mean) to control for outliers. For instance, Arizona State University has the highest mean number of faculty citations (one of their faculty members has the highest number of citations among planning programs), but is ranked 12th using the median number of citations.
- While I am quite confident in the results, there are inevitable errors in the data attributable to the following:
- Citation data are dynamic and change daily. What is presented below is a snapshot at a particular point in time.
- The uniqueness of author names influences the accuracy of citation counts. Common names, name changes, non-use of middle initials or middle names (by authors or publishers), misspellings, and other parsing errors can lead to improperly attributed publications.
- The number of citations per year is used to control for the age of faculty members. Programs with older faculty are expected to have greater numbers of citations – just by virtue of having more time. Unfortunately, the exact year that a faculty member started their academic career is not known, so the year they obtained their terminal degree is used as a proxy. There is also no data available on leaves taken or time off.
- I use data directly from Google Scholar Citations where faculty have existing profiles. These are assumed to be correct and contain only publications authored or co-authored by them. There were 202 profiles out of the 923 faculty included in the analysis.
I welcome your questions, comments, and suggestions.
Table 1 list the top 25 planning schools based on the median number of GS citations per faculty member. Table 2 lists the top 25 in terms of citations per year of service (or year since degree) to account for faculty age or experience.
The citation data can also be compared by the school where each faculty member received their terminal degree (usually a PhD). Table 3 shows the top 25 universities (not necessarily planning degrees) in terms of median total citation output.
Although there is a significant amount of variation among individual planning faculty citations that effect department-level performance, there are distinct trends based on seniority. Figures 1 and 2 show both increasing mean and median citation totals by years of experience and rank.
Finally, there are many planning faculty with citation totals far exceeding the average levels discussed (the top 25 are shown in Table 4). All of the previous summary information for planning schools is based on GS citation totals for individual planning faculty. These totals will change over time as the data are corrected and updated as previously mentioned. Please direct your questions or comments to me at: firstname.lastname@example.org.
Table 4. Top 25 cited planning faculty
|3||James W. Varni||20,209|
|6||Harry W. Richardson||12,370|
|11||Lawrence D. Frank||8,954|
|12||Michael K. Lindell||8,546|
|13||John M. Bryson||8,219|
|21||John R. Pucher||5,619|
*This table was updated on 10/9/2014 due to an error detected in Google Scholar citation counts.
The TechniCity preview will launch this week (see: https://www.coursera.org/course/techcity). One exciting aspect is the geographic diversity of students enrolled in the class. As we learned last time, this adds richness to our discussions and the examples that students share with each other. We are excited about the start of the class and look forward to connecting with the global TechniCity.
Check out the newly released TechniCity eBook! In this eBook we outline the TechniCity Massive Open Online Course (MOOC) that was conducted in the Spring of 2013. The eBook can be used as an introduction and guidebook for the course because it describes the course structure and provides examples of course activities. Because the course will grow and change over time, revised versions of the TechniCity eBook will be made available. (Click to download)
The following are the top 25 student projects as selected by the TechniCity instructors. There were many, many great projects overall! Click on the title to read more about the project.