Modernizing America’s Workforce Data Architecture
Modernizing America’s Workforce Data Architecture
Using Open Data Standards to Enhance the Quality and Availability of Online Job Postings
This report calls for using open data standards to improve the quality and availability of online job postings, and in turn, enhance competition and innovation in the market for job search-and-match applications.
In this article
Introduction and summary
Economists have long recognized the importance of high-quality information to the labor market. Without knowledge of opportunities available or skills in demand, searching for a job can become costly, not to mention miserable. By contrast, widely available and high-quality labor market information can make the process of finding new opportunities easier and more efficient.1 Accessing and utilizing such relevant and granular information, however, has long proved challenging. Going at least as far back as the 1930s, the public and private sectors have experimented with innovative ways to reduce search costs and informational frictions.2 Ideas have included greater use of public and private intermediaries to gather and disseminate information on the labor market, better end-user services that match workers with employers, and, more recently, efforts to enhance and/or supplement publicly available information with richer private sector data.3 Few, however, have considered more fundamental refoms aimed at how real-time labor market data is published and shared in the first place.
Over the past two decades, online job postings have emerged as a principal mechanism for signaling real-time information about the labor market. Their movement to the web has reduced the costs of advertising openings, enabled more functionality for employers to convey information, and made it easier to aggregate postings into central repositories.4 Together, these advances have transitioned online job postings from mere advertisements to increasingly informative signals of real-time labor market demand. Yet, more can be done for online job postings to reach their full potential. First, while they have become a commodity of sorts for online job search tools, online postings have also become concentrated in a small number of third-party applications that constrain easy data sharing and reuse. Second, postings frequently leave out pertinent information such as wage and skill requirements. And third, postings are seldom published in consistent, machine-readable formats that would make it easier for algorithms and third-party applications to make better use of them. These constraints hinder not just the quality of available data arising from online job postings, but also competition and innovation among the job search-and-match services that rely on such data.
The labor market would benefit from a collaborative data governance strategy that mitigates the influence of data monopolies—in which a few companies have unparalleled access to job postings—and that enables a more seamless exchange of high-quality real-time data. In other sectors of equivalent national importance, a powerful policy instrument has been the encouragement and implementation of open data standards—consistent machine-readable formats for how information is published online.5 From health care to energy to education—all industries where data is a critical asset—the use of open standards has made information easier to access, query, and share. This, in turn, has enabled more competitive markets for third-party applications and services.6
A similar opportunity now exists for the labor market. The broad adoption by employers of an open data standard would make online job postings better sensors of real-time labor market demand. Specifically, it would ensure that postings are more widely disseminated; it would nudge job descriptions to be more consistent, detailed, and precise articulations of employers’ needs; and it would make algorithmically curating specific information from a posting—such as skill keywords or evolving technology requirements—substantially easier.
From job seekers and businesses to education providers, policymakers, and innovators, this would benefit nearly all labor market stakeholders. For one, the resulting data could serve as a critical building block for a more robust and responsive public support system for job changes and job training. It could also be a boon to researchers studying evolving trends in skills and labor markets.7 It may even accelerate advances in machine learning and artificial intelligence being applied for better job matching, improved recommendation services, and more sophisticated local labor market insights.8
This report first reviews the limitations of online job postings as real-time sensors of labor market demand, describes the benefits of open data standards, and explains why the public sector is well-suited to facilitate their adoption. Second, it examines two pilot efforts that are currently testing potential policy approaches. Finally, it provides a set of policy recommendations through which federal and state governments can facilitate the development of an open data standard and encourage its adoption.
The limitations of online job postings and real-time labor market data
Job postings are a crucial but not well-understood aspect of the job search process.9 Signaling job titles, job locations, and required skills and credentials, online job postings are powerful indicators of labor market demand. Over the past several decades, through technical innovations, postings have become cheaper to advertise, revise, and amass. This has subsequently increased their value as a resource for online job search tools. Yet, for several reasons, job postings have yet to reach their full potential as a definitive primary source of real-time labor market information.
Restrictions on reuse
First, there are problems with access. The past two decades have been marked by an emerging market for third-party job search tools.10 These applications have improved the job search experience in important ways.11 Employers upload ads for job openings to these platforms knowing that they will reach a robust network of job seekers. Platforms may also harvest postings by regularly scraping the web. In building out these job listing repositories, these entities cultivate some of the richest labor market information available. However, third parties can also apply frictions on the reuse of those aggregated postings, largely on account of valuable intellectual property used in the curation, normalization, and organization of that data. These frictions, however, can be applied to the pre-processed data—the initial aggregation of raw job postings. Through technical mechanisms, legal restrictions, or expensive fees, these frictions can end up stifling the broad dissemination of online job postings.12
Labor market data are best utilized when widely available. Proprietary restrictions can make accessing such real-time data either difficult or prohibitively expensive. This, in turn, hinders utility. As Woods and O’Leary write, “while a proprietary firm rightly would desire to maximize profits from selling [labor market information], such an approach would not likely optimize use of the information to improve efficiencies in the overall labour market.”13 Moreover, Woods and O’Leary caution that proprietary data may poorly cover important parts of the labor market—“particular niches” but not “a nationwide system.”14 There is some evidence of this. A comparison of online job postings by the private job board CareerBuilder and the monthly U.S. Bureau of Labor Statistics’s Job Openings and Labor Turnover Survey found that the CareerBuilder data overrepresented fields such as finance and insurance and underrepresented state and local government, food services, accommodation, and construction.15 This may be attributable to the distribution of jobs that can be found online, with some sectors still unlikely to use the web as a primary method for recruitment. However, the potential of a gap provides another reason for a more open data architecture.
Finally, restrictions on reuse can stymie the development of new products, services, or analysis, while serving as a competitive moat for existing platforms and aggregators. Greater burdens on accessing critical job posting data can pose a barrier to innovators and entrepreneurs who might wish to enter the market for providing real-time labor market services and applications.16 This entry barrier is further compounded by the fact that third-party platforms have grown fairly concentrated. A 2014 report published in the American Economic Review found that “about 60 percent of all ads appear on five job boards,” while a forthcoming paper in the Journal of Public Economics reports that a single private sector job board included more than a third of all U.S. job postings.17 Improving the overall utility of job postings as signals of labor market demand will mean ensuring that postings are more widely available and interoperable across third-party applications.
Insufficient and inconsistent quality
Next, online job postings could be more informative signals of labor market demand. Evidence points to a generally low level of quality marked by the frequent absences of critical information, inconsistent descriptions, as well as a tendency for postings to be outdated or misleading. Economist Vera Brencic, for example, has looked at job listings from several countries, finding that employers differ widely in the amount of information they include, such as required skills and wages.18 A separate analysis of a large U.S. private job board found that only a fifth of the online job postings included projected wages.19 A 2015 survey of several hundred U.K. postings found that just 12 percent met the minimum job quality standard used by the nation’s Advertising Standards Authority.20
Although it may be the case that employers are simply choosing not to include this information, the variability for what is included and how such information is defined may be in part a function of the way employers post ads for vacancies.21 Most employers, be they large or small, post job listings on their own, with little sense of, or no standardized template for, what constitutes a high-quality listing. This decentralized process avoids the costly latency that would come with someone dictating job descriptions from on high, but nonetheless contributes to the inconsistency—not to mention the insufficiency—of the information found in job postings. Adding to this challenge, as economist Peter Diamond has noted, “a central element in the labor market is that workers and jobs vary greatly.”22” labor market information due to the “intrinsic heterogeneity of workers and jobs.” Autor, “Wiring the Labor Market.”] This heterogeneity among skills, industries, and credentials makes preserving a consistent level of quality across all job postings naturally more difficult.23 Some have even argued that skills in demand may be evolving at an accelerated rate due to changes in technology, a trend that could make the task of capturing nuance more formidable as well as more important.24
If employers and job seekers continue to rely on online job postings as sensors of real-time labor market demand, the consistency and detail of job postings must be improved. Indeed, job seekers should be well-served by such an improvement. New research, for example, shows that relative to other factors, the words contained in job titles play a powerful function in guiding job applicant behavior.25 Similar benefits may accrue if employers were to adopt more appropriately standardized and detailed skill and competency requirements.
Inadequate access to standardized, structured data
The final limitation on online job postings is that a narrow number consistently adhere to a standardized, open, and machine-readable format or structure. This makes postings less useful as signals of labor market demand.
When job seekers read a posting online, they easily discern various elements of the ad, such as skills, wages, and/or benefits. However, when a machine queries the web for postings, without the benefit of a standardized data structure or markup that provides context for what is included in the text—metadata—this task inevitably becomes more difficult.26 To roughly analogize, imagine reading a tax return without a format clearly delineating different types of income, exemptions, credits, and deductions. It would be nearly incomprehensible. Similarly, without a consistant format or structure, algorithmically making sense of postings becomes harder. Although dominant third-party applications have in some cases begun to use techniques such as natural language processing and machine learning to parse unstructured data, these advances are limited to a small number of firms.
Separately, even when online job postings are structured, different postings frequently have different markups. Unless third-party applications are familiar with the specific markup, they are hard-pressed to use those postings.27 This constrains the interoperability of a job posting once it is published and ultimately leads to siloed data or reduced job board quality.28 If online job postings are to fully realize their potential as machine-readable and interoperable sensors of labor market demand, broader technical reforms are needed for how postings are published, accessed, and used.
Open data standards for online job postings
One potential approach to improve online job posting quality and availability would be for labor market stakeholders to reach consensus on an open data standard for online job postings. This would not be a standard for the specific job titles or tasks that are unique to each employer, but rather for how such categories of information are published on the web.
What is an open data standard?
From screws and fire hydrants to telephone networks and internet protocols, standards ensure compatibility between products and services. As studies of standardization efforts have shown, such compatibility can result in “considerable gains to consumer welfare.”29 By harmonizing the interactions within a system, standards create opportunities for innovation and entrepreneurship as well as greater consumer choice.30 This is especially true of the exchange of real-time information across the internet. As data have grown more valuable and third-party applications that make use of data feeds have proliferated, there is a growing demand for data to be structured and seamlessly exchanged in a neutral way across platforms and applications.31
This has led to the creation of voluntary, industry-led data standards for online content. A data standard “describes, explains, locates, or otherwise makes it easier to retrieve, use, or manage an information resource.”32 Inconsistent publishing formats are akin to mismatched fire hoses and hydrants; the incongruence stymies the flow of the information. By comparison, a consistent data standard makes it easier for third-party applications to find, parse, and utilize content regardless of where it is published. As a 2016 Obama administration report noted, data standards can “reduce the cost and difficulty of making new data sets useful.”33
One such effort is Schema.org, an initiative among leading search engines to standardize the back-end framework for specific types of web and app content.34 Categories include blogs, movies, and restaurants.35 For each category, Schema.org has established generic but standardized technical structures—schema—underlying the text of a webpage.36 By adding context, or structure, to the text of a webpage, the schema makes it easier for such content to be identified and used.37
Applied to online job postings, a data standard would enable stakeholders—from innovators to developers of state-based workforce development systems—to more seamlessly take advantage of online job postings as real-time signals of demand.38 First, it could serve as a template for employers, providing suggestive parameters for what to include in postings. This could nudge employers toward more consistent and precise job posting descriptions, while preserving their autonomy to advertise as they deem fit. Second, if broadly adopted by employers, a data standard could make online postings more widely available, resulting in more robust competition and variation among third-party applications that put job postings to use. This could also support researchers and policymakers, allowing them to be less reliant on vendors or aggregators for raw labor market data or to more efficiently use such firms for value-added insights or services.
The public sector’s role in standard setting and labor market information
The public sector, with its experience facilitating standards development and its long-held role providing timely labor market information, is well suited to organize a consensus-seeking effort to design and adopt a job posting data standard.
First, going back to the early 20th century and the development of the National Bureau of Standards—now known as the National Institute for Standards and Technology (NIST)—the U.S. government has played a role in facilitating sectorwide norms and guidelines.39 The Obama administration was particularly active in convening outside stakeholders to design and adopt standards aligned with key policy priorities. Examples of these efforts include NIST and the U.S. Department of Energy working with industry to make energy consumption data available to consumers, as well as a NIST-facilitated effort encouraging the adoption of voluntary industry-led standards and best practices for cybersecurity.40 The authority for these efforts was articulated in a 2012 White House memorandum outlining the involvement of the federal government in encouraging and facilitating standards for “national priorities.”41
In addition to facilitating standards, since as far back as the passage of the Wagner-Peyser Act of 1933, the public sector has also been a critical player in the provision of real-time labor market information.42 Over the years, government has frequently harnessed new technologies to enhance the quality and dissemination of these data. During the 1970s, for example, state employment services began to collect and share labor market information with other states through such innovations as the Employment Security Automated Reporting System.43 This ended up being the antecedent of the more formulized Interstate Job Bank: “a national database containing state job openings from employers who requested nationwide listings,” and, later, America’s Job Bank, a web-based interface for job and resume posting.44
While America’s Job Bank is no longer in operation and, in many cases, public actors from state governments to community college systems are purchasing granular labor market insights from third-party vendors, there remains a general recognition that “providing information to the public is one of the primary rather than ancillary functions of the public workforce investment system.”45 Specifically, the secretary of the U.S. Department of Labor (DOL) is required to “oversee the development, maintenance, and continuous improvement of a nationwide workforce and labor market information system,” including ensuring the “dissemination of such data, information, and analysis in a user-friendly manner and voluntary technical standards for dissemination mechanisms.”46 Additionally, states are required to administer labor exchange systems that, among other things, “assist job seekers in finding employment … assist employers in filling jobs; [and] facilitate the match between job seekers and employers.”47
The combination of these policy legacies, unique capabilities, and existing authorities makes the federal government a natural fit to bring together requisite stakeholders and accelerate the design of an open data standard for online job vacancies.
Two case studies are already showing progress toward the development, adoption, and use of an open data standard for online job postings. These pilot projects show how a data standard for job postings can be implemented as well as how the resulting data can be harnessed for new applications and analysis.
The United Kingdom: Adopting a schema
Spurred by a 2015 survey finding that just 12 percent of U.K.-based job postings included sufficient information to meet country-certified quality standards, the British government began to search for ways to enforce a baseline level of quality for job posting content.48 Research by the country’s Government Digital Service resulted in an initiative to have civil service job listings adopt a data standard.49
The idea for an open data standard was inspired by an initiative championed by the Obama administration back in 2011 called the Veterans Job Bank.50 The job bank was a repository of job postings from employers making an explicit commitment to prioritize the hiring of veterans. To create a relevant and up-to-date list of postings, the Executive Office of the President partnered with Schema.org to design and adopt an open data standard.51 Built with industry participation, the resulting JobPosting schema (see Table 1) enabled employers to mark up, or tag, job postings where the employer had made a commitment to hiring veterans, thus making it easier to algorithmically find, aggregate, and publish these postings in real time and at low cost.52
In researching this effort, the United Kingdom saw the potential for a broader goal: using the schema as an overall template for what should be included in job listings.53 The government realized that such an intervention would make data on job postings easier for third-party websites and applications to algorithmically parse, query, and reuse.54 Excited about the potential, the Government Digital Service began a thorough review process to determine whether or not this information technology standard should be implemented. The review included a preliminary exam by a panel of open standards experts followed by a subsequent review by the Open Standards Board, a government-appointed coalition.55
As of 2017, the United Kingdom has been implementing the schema’s adoption across all central government openings.56 Agencies not under the direct jurisdiction of the central government are also being encouraged to adopt the schema. The U.K. Government Digital Service is assisting with the adoption by providing implementation guidelines, informal trainings, and a communication channel.57 Meanwhile, Britain’s Department for Work and Pensions has prototyped a series of different citizen-facing services that could take advantage of the schema.58 The government’s expectation is that over time, the private sector will also take steps to adopt the open data standard.
Virginia: Publishing real-time data on labor market demand
The second case study comes from Virginia. The state is showing what is possible if a data standard were to be broadly adopted. In 2014, the governor of Virginia signed Executive Order 23: “Establishing the New Virginia Economy Workforce Initiative.”59 The order led to the creation of the Commonwealth Consortium for Advanced Research and Statistics (CCARS).60 Working together with the Discovery Analytics Center at Virginia Tech, CCARS coordinated the development of a new pilot project with which one of this report’s authors is affiliated. Called the Open Data, Open Jobs Initiative, the goal was to capture and publish a real-time structured data feed of all online job postings in Virginia that would serve as a proof of concept.61
Building this feed involved several steps. First, it required establishing data-sharing agreements with three major data sources of Virginia job postings. These included the state-based job board Virginia Workforce Connection, the DirectEmployers Association’s National Labor Exchange, and job postings that continued to use the JobPostings schema initiated under the 2011 Veterans Job Bank initiative highlighted above. Together, this provided the Virginia Tech team with a sufficient pool of Virginia’s job openings.62
From this repository, the team removed duplicative postings and transformed unstructured ads into structured job postings. The resulting structured job postings were then enriched and normalized, a process whereby missing information—such as job location—was filled in and information such as job title or industry sector was matched to a standardized identifier from public classifications such as the North American Industry Classification System (NAICS) or the Occupational Information Network (O*NET).63 The result was a single, machine-readable, publicly available dataset of Virginia’s job postings: a snapshot of the labor market from which anyone, from workforce practitioners to developers, could create visualizations, generate research insights, and even develop new job search-and-match tools. The feed is available via an open data portal hosted by Virginia Tech.
In 2016, developers used this dataset during Virginia’s Workforce Innovation Challenge Datathon.64 During the two-day challenge, industry professionals and students were charged with developing applications. At least three new applications are presently using the initiative’s data.65 The project is now working with economists and other partners to add insights to the data such as median wage information, normalized job titles, industry and organization codes, and geolocation information.66 It is also continuing to look for new data-sharing partners to improve coverage.
This section outlines several policy recommendations for how federal and state governments can develop a data standard, encourage its adoption, and take advantage of the resulting infrastructure. Recommendations include facilitating an industry-led open data standard, encouraging employer adoption of that standard, and harnessing the resulting data for new tools and research.
Facilitating an industry-led open data standard
First, a broad set of labor market stakeholders needs to find consensus around what a quality job posting should look like on the web. What are the fields—salary, location, hours, education requirements, and skill keywords—that should consistently define job postings? The U.S. government, with its power to convene outside entities and its prior experience facilitating standards development, is well-suited to bring together the requisite stakeholders to accelerate this design.67 In the spirit of internet-based standards efforts, this initiative would benefit from agile development—encouraging employers and application developers to publish information according to initial consensus recommendations, gathering feedback from early adopters to recommend changes, and iterating on an implementation guide. Moreover, as the U.K. case study above demonstrates, any such process should be transparent and inclusive in order to ensure that all voices are heard.68
Encouraging employer adoption
Once an open data standard and accompanying implementation guide are published, the next step is facilitating broad adoption. The decentralized nature of the labor market makes for a challenging collective action problem. How does one encourage small and medium-sized enterprises to adopt a technical standard for online job postings that conforms to industry-led guidelines? The public sector has many tools it can use to galvanize support.
- Target key stakeholders to mark up job postings with a consensus standard. Standards work when stakeholders realize benefits from participation and use. To generate participation, the public sector should encourage “early adopters” among stakeholders that already collect job postings data across the country—including private sector job search-and-match tools, educational institutions, regulators, and labor unions—to contribute the initial data feeds. At a minimum, the largest private and public job boards could mark up their postings using an open, consensus format, as the Virginia pilot project described above is doing. Such an approach would capture a large share of existing online postings and may even help spur employers to adopt a data standard when they post a job ad in the future. However, such an approach is premised on the idea that the resulting structured data would be publicly accessible without intellectual property restrictions.
- Lead the way with federal and state job postings. Getting industry to adopt a schema will be harder if governments are not leading by example. Following in the footsteps of the U.K. government, federal, state, and local U.S. governments should apply the industry-led job posting standard to their own postings. The sheer size of the public sector workforce could spur broader adoption of the schema within the private sector.
- Incentivize federal contractors to adopt the schema through VEVRAA. The federal government could use current regulations associated with the Vietnam Era Veterans’ Readjustment Assistance Act of 1974 (VEVRAA) to incentivize all federal contractors to adopt a schema. VEVRAA requires that when listing job openings, “contractors must provide information about the job vacancy in any manner and format … which will allow that system to provide priority referral of veterans protected by VEVRAA.”69 By taking advantage of the data standard to help meet the regulatory requirements for priority referrals, government can ease the costs and difficulty associated with regulatory compliance and get better outcomes as a result. It could both improve posting quality and make it easier for application developers to help veterans find better job matches.
- Provide aid to small and medium-sized employers. While unlikely to be a significant sum, there may be costs associated with adopting a standard. Allocating a small portion of funding from existing workforce data system budgets to assist small and medium-sized businesses with adoption could encourage further participation. Additionally, states should consider building out data science and developer expertise to help with schema adoption and maintenance. Just as the Virginia case study above harnessed the talent of the data science team at Virginia Tech, states could rely on existing talent networks from local colleges and universities.
Harnessing new data for new tools and research
The goal of public sector-led standardization is to establish a consistent infrastructure that can support new services and applications.70 Easy to access, timely, and structured job posting data could lower barriers to entry for innovators and, in doing so, spur novel workforce tools and services. Below are several ideas for how to ensure that resulting data are utilized.
- Encourage states to build out their own repositories. The public nature of labor market information ensures that “there can be a productive role for government services to provide labor market information to workers.”71 States have long served as information clearinghouses for the labor market. And Virginia is now demonstrating that states can even curate their own real-time data feed. Rich, clean, up-to-date data would benefit local and state-level workforce practitioners, not to mention innovators. In providing this service, states can strengthen their existing role as crucial intermediaries for real-time labor market data.72
- Continue to sponsor opportunities to engage developers and innovators. The Obama administration worked to engage the developer community through initiatives such as “hackathons” and “data jams.”73 These events brought together developers in order to introduce them to new datasets and let them design proof of concepts with such data. The current administration, states, and nonprofits should each continue these efforts to encourage broader usage of raw job postings data. Again, Virginia provides a good model for this effort.
- Continue to build out a real-time occupational taxonomy. A recent report from the National Academies of Sciences, Engineering, and Medicine made clear that “policy makers and researchers would benefit significantly from a better understanding of evolving IT options and their implications for the workforce.”74 Job postings often signal these changes, with skill descriptions evolving as new technologies emerge. The broad adoption of a data standard would make it easier to mine postings for new occupational titles, skills, and associated technologies. In fact, this effort is already underway. The DOL in partnership with the University of Chicago has an ongoing effort called the Open Skills Project to rethink how occupational classifications are built. The team is presently working on a real-time occupational classification curated from employers’ own job descriptions.75 An effort to get employers of all sizes to adopt a schema would greatly benefit initiatives such as this one.
- Competition in data-intensive markets. Real-time labor market information with its “public good” characteristics offers an opportunity to think more broadly about the competitive effects of data and how to enhance competition where digital platforms abound.76 Ensuring frictionless access to online job postings will encourage applications to distinguish themselves through innovative interfaces or new methods of curation, rather than simply the size of their job listing network. This should further enhance competition in the job search-and-match market. Although the degree to which such an intervention can be applied to other cases remains unknown, the template seems worth further investigation.
- Encouragement of standard setting through convening diverse stakeholders. This report shows the potential of an underutilized policy lever: working with industry and other stakeholders to encourage the broad adoption of uniform standards for national priorities short of formal regulation or government operation. Additional research is needed to better understand the incentives required for collaboration, but the approach provides a flexible tool for policymakers, especially in sectors subject to rapid technological innovation.
Back in 1966, economist Albert Rees published “Information Networks in Labor Markets.” In the article, he noted the following:
For the major portion of the [labor] market, the crucial characteristic of an effective formal information system is not the length or the number of interconnections between geographical locations or the number of applications and openings that can be brought together at one place. Rather, it is the richness and reliability of the information carried over each link. The crucial component of such a system will not in our lifetimes be built by I.B.M. or Western Electric.77
Much has changed since Rees first made these observations, yet in many ways his comment still holds true. Over the past few decades, online job postings have become a primary source for real-time information on the labor market as well as a currency for new job search tools and applications. However, access to online job postings is increasingly concentrated within a few companies and postings themselves are frequently of low quality. Far from being sensors of real-time data, today’s postings seem far more reminiscent of their newspaper predecessors.
There is now a substantial opportunity to enhance the availability and quality of real-time labor market data by improving how job postings are published online. This report calls for the adoption of an open data standard for all online job postings. A standard would make online postings clearer signals of real-time demand and would help avoid the creation of data monopolies by making postings more widely available. Furthermore, facilitating the adoption of such standards would be largely in line with existing government policy to work with outside stakeholders toward “a shared commitment to a defined level of responsible behavior” and to provide rich labor market information.78 An open data standard will ensure that information on labor market demand is more timely, accessible, and of higher quality. With luck, we may even establish that “crucial component” that Rees first mentioned so many decades ago.
About the authors
Aneesh Chopra is a senior fellow at the Center for American Progress and the president of CareJourney, a Hunch Analytics company, where he also serves as executive vice president. Chopra is the former—and first—U.S. chief technology officer. He also authored the book Innovative State: How New Technologies Can Transform Government.
Ethan Gurwitz is a research associate with the Economic Policy team at the Center for American Progress. Prior to joining the Center, he worked as a research associate for the 2012 Obama re-election campaign in Chicago and for the 2013 special election for Sen. Ed Markey (D-MA). He holds a bachelor’s degree from Northwestern University.
The authors are grateful for discussions and comments from Ioana Marinescu, economist at the University of Pennsylvania; Rupinder Paul Khandpur at the Discovery Analytics Center at Virginia Tech; former and current staff at the U.K. Government Digital Service; and the staff involved with the Virginia Commonwealth Consortium for Advanced Research and Statistics.
- As James Woods and Christopher O’Leary make clear, “the summary of existent studies is consistent with a logic model concept, in which information on the key needs of the market, e.g., skills, knowledge, abilities, job openings, wage rates, etc. can facilitate a more efficient market.” See James F. Woods, and Christopher J. O’Leary, “Conceptual Framework for an Optimal Labour Market Information System: Final Report” (Kalamazoo, MI: WE. Upjohn Institute for Employment Research, 2006), available at http://research.upjohn.org/cgi/viewcontent.cgi?article=1025&context=up_technicalreports.
- See Christopher J. O’Leary and Randall W. Eberts, “The Wagner-Peyser Act and U.S. Employment Service: Seventy-Five Years of Matching Job Seekers and Employers” (Kalamazoo, MI: W.E. Upjohn Institute for Employment Research, 2008), available at http://research.upjohn.org/reports/29.
- David H. Autor, “Studies of Labor Market Intermediation: Introduction.” In David H. Autor, ed., Studies of Labor Market Intermediation, (Chicago: University of Chicago Press, 2009), available at http://www.nber.org/chapters/c3593.pdf; David H. Autor, “Wiring the Labor Market,” Journal of Economic Perspectives 15 (1) (2001): 25–40, available at https://economics.mit.edu/files/11568; Jim Woods and Pam Frugoli, “Information, Tools, and Technology: Informing Labor Exchange Participants.” In David E. Balducchi, Randall W. Eberts, and Christopher J. O’Leary, eds., Labor Exchange Policy in the United States (Kalamazoo, MI: W.E. Upjohn Institute for Employment Research, 2004), available at http://research.upjohn.org/up_bookchapters/159/; John Dorrer, “Using Real-Time Labor Market Information to Achieve Better Labor Market Outcomes” (Lumina Foundation, 2016), available at https://www.luminafoundation.org/files/resources/using-real-time-labor-market-information-full.pdf; The Aspen Institute, College Excellence Program, “Using Labor Market Data to Improve Student Success” (2014), available at https://assets.aspeninstitute.org/content/uploads/files/content/docs/ccprize/LaborMarketDataGuide.pdf; National Academies of Sciences, Engineering, and Medicine, “Information Technology and the U.S. Workforce: Where Are We and Where Do We Go From Here?” (Washington: The National Academies Press, 2017), available at https://www.nap.edu/catalog/24649/information-technology-and-the-us-workforce-where-are-we-and.
- Autor, “Wiring the Labor Market”; see also Peter J. Kuhn, “The Internet and Matching in Labor Markets.” In Derek C. Jones, ed., New Economy Handbook (Amsterdam: Academic Press, 2003), available at http://econ.ucsb.edu/~pjkuhn/Research%20Papers/Handbook.pdf.
- The Center for Open Data Enterprise, “The 2016 U.S. Open Data Roundtables: Recommendations From Data Providers and Users” (2016), available at http://reports.opendataenterprise.org/2016opendataroundtables.pdf; Executive Order no. 13642, Code of Federal Regulations, “Making Open and Machine Readable the New Default for Government Information” Vol. 78, No. 93 (2013), available at https://www.gpo.gov/fdsys/pkg/FR-2013-05-14/pdf/2013-11533.pdf; Centers for Medicare and Medicaid Services, “Blue Button on FHIR: Improving Medicare Beneficiary Access to Their Health Information” (2016), available at https://www.cms.gov/Research-Statistics-Data-and-Systems/CMS-Information-Technology/Blue-Button/index.html; U.S. Department of Energy, “Green Button: Open Energy Data,” available at https://energy.gov/data/green-button (last accessed June 2017).
- See, for example, FTI Editors, “Government Agencies Leading the App Economy, Using Innovation to Drive Economic Growth” Federal Technology Insider, May 23, 2014, available at https://federaltechnologyinsider.com/government-agencies-leading-app-economy-using-innovation-drive-economic-growth.
- A report from the National Academies of Sciences, Engineering, and Medicine noted “Changes in technology use affect the roles of workers and contribute to changing labor and skills demands. This creates challenges for individuals planning their career strategies and for employers, educational institutions, and policy makers.” See National Academies of Sciences, Engineering, and Medicine, “Information Technology and the U.S. Workforce.”
- See, for example, Christian Posse, “Cloud Jobs API: machine learning goes to work on job search and discovery Google Cloud Platform,” Google Cloud Big Data and Machine Learning blog, November 15, 2016, available at https://cloud.google.com/blog/big-data/2016/11/cloud-jobs-api-machine-learning-goes-to-work-on-job-search-and-discoveryhttps://cloud.google.com/jobs-api/.
- Ioana Marinescu and Ronald Wolthoff, “Opening the Black Box of the Matching Function: The Power of Words.” Working Paper 22508 (National Bureau of Economic Research, 2016), p. 4, available at http://www.nber.org/papers/w22508; Steven J. Davis, R. Jason Faberman, and John C. Haltiwanger, “The Establishment-Level Behavior of Vacancies and Hiring,” The Quarterly Journal of Economics 128 (2) (2013): 581–622, available at http://econweb.umd.edu/~haltiwan/Establishment_Level_Behavior_Vacancies_Hiring_QJE_2013.pdf.
- See Peter J. Kuhn, “The Internet As a Labor Market Matchmaker: How Effective Are the New Electronic Methods of Worker Recruitment and Job Search?” (Bonn, Germany: IZA World of Labor, 2014), available at https://wol.iza.org/uploads/articles/18/pdfs/internet-as-a-labor-market-matchmaker.pdf; Autor, “Wiring the Labor Market”; for a survey of labor market tools, see Freedman Consulting, LLC, “Swiping Right for the Job: How Tech Is Changing ‘Matching’ in the Workforce” (New York: JPMorgan Chase & Co., 2016), available at https://www.jpmorganchase.com/corporate/Corporate-Responsibility/document/nsaw-tech-training-report-web.pdf.
- For instance, some of these firms have designed exhaustive taxonomies of jobs and skills that are in demand to better match workers’ competencies with the needs of employers. Others have fairly sophisticated insights into labor demand at the local and regional level. See Faizan Javed and others, “Towards a Job Title Classification System” (2016), available at https://arxiv.org/ftp/arxiv/papers/1606/1606.00917.pdf; The Center for Open Data Enterprise, “Open Data for the Labor Market: An Open Data Roundtable With the U.S. Department of the Labor” (2016), available at http://reports.opendataenterprise.org/DOLOpenDataRoundtableReport.pdf; Posse, “Cloud Jobs API: machine learning goes to work on job search and discovery Google Cloud Platform”; The Aspen Institute’s College Excellence Program, “Using Labor Market Data To Improve Student Success.”
- Marinescu and Wolthoff, “Opening the Black Box of the Matching Function.”
- Across sectors, data access increasingly seems to be a barrier of entry. Says former Council of Economic Advisers Chair Jason Furman on the analogous case of data access for search engines: “Search engines today collect data on the behavior of their users and use it to improve their services and tailor those services to individual users. Thus, for other firms to be competitive they need a large user base and the data that comes with it.” Jason Furman, “Beyond Antitrust: The Role of Competition Policy in Promoting Inclusive Growth” (Chicago: Searle Center Conference on Antitrust Economics and Competition Policy, 2016), available at https://obamawhitehouse.archives.gov/sites/default/files/page/files/20160916_searle_conference_competition_furman_cea.pdf.
- Ayşegül Şahin and others, “Mismatch Unemployment,” American Economic Review 104 (11) (2014): 3529–3564, available at https://www.aeaweb.org/articles?id=10.1257/aer.104.11.3529; Ioana Marinescu, “The General Equilibrium Impacts of Unemployment Insurance: Evidence From a Large Online Job Board,” Journal of Public Economics 150 (2017): 14–29, available at http://www.marinescu.eu/Marinescu_UI.pdf.
- Vera Brenčič, “Wage Posting: Evidence From Job Ads,” Canadian Journal of Economics 45 (4) (2012): 1529–1559.
- See Marinescu and Wolthoff, “Opening the Black Box of the Matching Function.”
- See Citizens Advice, “Job Adverts, How They Can Be Improved for Job Hunters and Recruiters” (2015), available at https://www.citizensadvice.org.uk/Global/CitizensAdvice/Work%20Publications/JobadvertsrecommendationsFINAL.pdf; see also Reviews.com, “The Best Job Sites,” April 1, 2017, available at www.reviews.com/job-sites.
- For example, Marinescu and Wolthoff note that some employers use Applicant Tracking Systems software to remove posted wages before sending a posting to a job board. As the authors state, “If firms really cared about advertising wages, it would be suboptimal for them to rely on software that removes this information.” Marinescu and Wolthoff, “Opening the Black Box of the Matching Function”; Brenčič similarly notes that “employers consider the trade-off between improved search efficiency and the adversely affected pool of applicants that the posted wage attracts.” Brenčič, “Wage Posting.”
- Peter Diamond, “Unemployment, Vacancies, Wages,” American Economic Review 101 (4) (2011): 1045–1072, available at https://www.aeaweb.org/articles?id=10.1257/aer.101.4.1045; Economist David Autor similarly described the challenges of “commodify[ing
- For an example of this challenge, see Emmanuel Malherbe, Mario Cataldi, and Andrea Ballatore, “Bringing Order to the Job Market: Efficient Job Offer Categorization in E-Recruitment” (Santiago, Chile: Association for Computing Machinery Special Interest Group on Information Retrieval Conference, 2015), available at https://www.researchgate.net/publication/276206693_Bringing_Order_to_the_Job_Market_Efficient_Job_Offer_Categorization_in_E-Recruitment.
- National Academies of Sciences, Engineering, and Medicine, “Information Technology and the U.S. Workforce”; Steve Lohr, “New Tools Needed to Track Technology’s Impact on Jobs, Panel Says,” The New York Times, April 13, 2017, available at https://mobile.nytimes.com/2017/04/13/technology/artificial-intelligence-automation-report.html.
- See Marinescu and Wolthoff, “Opening the Black Box of the Matching Function.”
- Google Search, “Introduction to Structured Data,” Google Developers, available at https://developers.google.com/search/docs/guides/intro-structured-data (last accessed May 2017); Project Open Data, “Project Open Data Metadata Schema v1.1,” available at https://project-open-data.cio.gov/v1.1/schema (last accessed July 2017).
- R. V. Guha, Dan Brickley, and Steve Macbeth, “Schema.org: Evolution of Structured Data on the Web,” ACM Queue 13 (9) (2015): 44–51, available at http://queue.acm.org/detail.cfm?id=2857276.
- As one observer noted, “(Access to the) original posting is important. Aggregators that link to each other create a game of telephone: The more information that passes through multiple parties, the higher the probability for errors. Having access to the original post saves the time and frustration of fact checking if the job is even still open, let alone having to navigate yet another job site.” See Reviews.com, “The Best Job Sites.”
- See Jing Li, “Compatibility and Investment in the U.S. Electric Vehicle Market.” Working Paper (Cambridge, MA: Harvard University, 2017), available at http://scholar.harvard.edu/files/jingli/files/li_jmp.pdf.
- Ibid.; Subcommittee on Standards, National Science and Technology Council, “Federal Engagement in Standards Activities to Address National Priorities: Background and Proposed Policy Recommendations” (2011), available at https://www.nist.gov/sites/default/files/documents/standardsgov/Federal_Engagement_in_Standards_Activities_October12_final.pdf.
- Guha, Brickley, and Macbeth, “Schema.org.”
- Project Open Data, “Project Open Data Metadata Schema v1.1.”
- National Science and Technology Council, Preparing for the Future of Artificial Intelligence (Executive Office of the President, 2016), available at https://obamawhitehouse.archives.gov/sites/default/files/whitehouse_files/microsites/ostp/NSTC/preparing_for_the_future_of_ai.pdf.
- Schema.org, “Welcome to Schema.org,” available at http://schema.org (last accessed June 2017).
- Schema.org, “Full Hierarchy,” available at http://schema.org/docs/full.html (last accessed July 2017).
- Guha, Brickley, and Macbeth, “Schema.org.”
- Google Search, “Introduction to Structured Data.”
- Richard Pope, “Publishing Vacancies Online,” Standards Hub, February 20, 2014, available at https://standards.data.gov.uk/challenge/publishing-vacancies-online; see also Google Cloud Platform, “Cloud Jobs API.”
- Aneesh Chopra, Innovative State: How New Technologies Can Transform Government (New York: Grove/Atlantic, 2014); Subcommittee on Standards, National Science and Technology Council, “Federal Engagement in Standards Activities to Address National Priorities.”
- National Institute of Standards and Technology, “Green Button Initiative,” September 22, 2016, available at https://www.nist.gov/engineering-laboratory/smart-grid/hot-topics/green-button-initiative; Aneesh Chopra, “Modeling a Green Energy Challenge After a Blue Button,” The White House blog, September 15, 2011, available at https://obamawhitehouse.archives.gov/blog/2011/09/15/modeling-green-energy-challenge-after-blue-button; National Institute of Standards and Technology, Framework for Improving Critical Infrastructure Cybersecurity, version 1.1 (U.S. Department of Commerce, 2017), available at https://www.nist.gov/sites/default/files/documents////draft-cybersecurity-framework-v1.11.pdf.
- Memorandum from Aneesh Chopra, Miriam Sapiro, and Cass R. Sunstein to the heads of executive departments and agencies, “Principles for Federal Engagement in Standards Activities to Address National Priorities,” January 17, 2012, available at https://www.iccsafe.org/gr/Documents/AdoptionToolkit/FedStandardsMemo-011712.pdf.
- O’Leary and Eberts, “The Wagner-Peyser Act and U.S. Employment Service.”
- Ibid.; see also Woods and Frugoli, “Information, Tools, and Technology”; O’Leary and Eberts, “The Wagner-Peyser Act and U.S. Employment Service”; Neil Ridley and William A. Tracy, “State and Local Labor Exchange Services.” In Balducchi, Eberts, and O’Leary, eds., Labor Exchange Policy in the United States.
- Ridley and Tracy, “State and Local Labor Exchange Services.”
- O’Leary and Eberts, “The Wagner-Peyser Act and U.S. Employment Service”; Alice O. Nakamura and others, “Jobs Online.” In Autor, ed., Studies of Labor Market Intermediation; Maher & Maher, “Real-Time Labor Market Information: An Environmental Scan of Vendors and Workforce Development Users”; Woods and Frugoli, “Information, Tools, and Technology.”
- 29 U.S.C. § 49l–2.
- 20 C.F.R. § 652.3.
- Citizens Advice, “Job Adverts, How They Can Be Improved for Job Hunters and Recruiters”; Government Digital Service, “Guidance: Publishing Vacancies,” GOV.UK, January 26, 2017, available at https://www.gov.uk/government/publications/open-standards-for-government/publishing-vacancies-online-standards-profile–2.
- Government Digital Service, “Guidance: Publishing Vacancies”; Standards Hub, “Publishing Vacancies Online: Proposal,” August 13, 2015, available at https://standards.data.gov.uk/proposal/publishing-vacancies-online-proposal.
- Standards Hub, “Publishing Vacancies Online”; Aneesh Chopra, “Open Innovation for Heroes – Introducing the Veterans Job Bank,” The White House blog, November 7, 2011, available at https://obamawhitehouse.archives.gov/blog/2011/11/07/open-innovation-heroes-introducing-veterans-job-bank.
- Chopra, “Open Innovation for Heroes”; R. V. Guha, “Schema.org Support for Job Postings,” Schema blog, November 7, 2011, available at http://blog.schema.org/2011/11/schemaorg-support-for-job-postings.html; Schema.org, “About Schema.org,” available at https://schema.org/docs/faq.html (last accessed May 2017).
- Chopra, “Open Innovation for Heroes”; Guha, “Schema.org Support for Job Postings”; Aneesh Chopra and Ethan Gurwitz, “5 Policies for Improving Data Use to Accelerate Veteran Employment” (Washington: Center for American Progress, 2014), available at https://cdn.americanprogress.org/wp-content/uploads/2014/09/VeteransData.pdf.
- Government Digital Service, “Guidance”; see also Liam Maxwell and Dan Appelquist, “Making Job Adverts More Open,” Government Technology blog, May 18, 2016, available at https://governmenttechnology.blog.gov.uk/2016/05/18/making-job-adverts-more-open.
- Government Digital Service, “Guidance”; Maxwell and Appelquist, “Making Job Adverts More Open”; Pope, “Publishing Vacancies Online.”
- Government Technology blog, “Open Standards,” available at https://governmenttechnology.blog.gov.uk/open-standards (last accessed June 2017); Liam Maxwell, “The Open Standards Board,” Government Digital Service blog, April 15, 2013, available at https://gds.blog.gov.uk/2013/04/15/the-open-standards-board.
- Personal communication with product managers at the U.K. Government Digital Service, May 18, 2017; see also Government Digital Service, “Guidance.”
- Personal communication with product managers at the U.K. Government Digital Service, May 18, 2017.
- Jacquie Doyle and Richard Pope, “Learning Through Prototyping: Tools for Universal Credit Claimants,” DWP Digital blog, February 9, 2016, available at https://dwpdigital.blog.gov.uk/2016/02/19/learning-through-prototyping-tools-for-universal-credit-claimants.
- Office of the Governor, “Governor McAuliffe Unveils Major Workforce Development Initiative,” Press release, August 13, 2014, available at https://governor.virginia.gov/newsroom/newsarticle?articleId=5787.
- Office of the Governor, “Governor McAuliffe Announces Data Analytics Initiative to Connect Job Seekers to Jobs,” Press release, July 7, 2016, available at https://governor.virginia.gov/newsroom/newsarticle?articleId=15819; Virginia Tech, “Discovery Analytics Center Contributes Workforce Analytics for Governor’s Open Data, Open Jobs Portal,” November 30, 2016, available at https://vtnews.vt.edu/articles/2016/11/ncr-dacopendataopenjobs.html.
- Personal communication with CCARS leadership and Rupinder Paul Khandpur, Ph.D. student, Discovery Analytics Center, Virginia Tech, May 18, 2017.
- Ibid.; The North American Industry Classification System, or NAICS, “is the standard used by Federal statistical agencies in classifying business establishments” and industries for data collection purposes. See U.S. Census Bureau, “North American Industry Classification System,” available at https://www.census.gov/eos/www/naics (last accessed June 2016). The Occupational Information Network, or O*NET, is a classification of US occupations published by the U.S. Department of Labor. O*NET Resource Center, “About O*NET,” available at https://www.onetcenter.org/overview.html (last accessed June 2016).
- Datathon 2016, “Governor’s Workforce Innovation Challenge,” available at https://data.virginia.gov/datathon-2016 (last accessed July 2017).
- Personal communication with Rupinder Paul Khandpur, Ph.D. student, Discovery Analytics Center, Virginia Tech, May 9, 2017; The data is accessible via an API, or Application Programming Interface; a defined set of protocols to easily query data repositories. For a description, see Gray Brooks, “APIs in Government,” DigitalGov, April 30, 2013, available at https://www.digitalgov.gov/2013/04/30/apis-in-government.
- Personal communication with Rupinder Paul Khandpur, May 9, 2017.
- National Institute of Standards and Technology, “About NIST,” available at https://www.nist.gov/about-nist (last accessed May 2015).
- Phil Weiser, “Entrepreneurial Administration.” Working Paper 16-11 (University of Colorado Law School, 2017), available at https://ssrn.com/abstract=2893139; Project Open Data, “Standards, Specifications, and Formats Supporting Open Data Objectives,” available at https://project-open-data.cio.gov/open-standards (last accessed July 2017).
- Contractors can also use private job applications if they provide “the information to the appropriate employment service delivery system in any manner and format that the employment service delivery system permits which will allow that system to provide priority referral of protected veterans.” See 41 C.F.R. § 60-300.5.
- Chopra and Sinai, “Wholesale Government: Open Data and APIs.”
- Council of Economic Advisers, Active Labor Market Policies: Theory and Evidence for What Works, (Executive Office of the President, 2016), available at https://obamawhitehouse.archives.gov/sites/default/files/page/files/20161220_active_labor_market_policies_issue_brief_cea.pdf.
- Ian Rosenblum and Christopher Spence, “Success in Real-Time Using Real-Time Labor Market Information to Build Better Middle-Skill STEM Pathways” (Boston: Jobs for the Future, 2015), available at http://www.jff.org/sites/default/files/publications/materials/Success-in-Real-Time-122214.pdf; A report from the National Academies of Sciences, Engineering, and Medicine called for the creation of data hubs—centers that aggregate public and private data to provide the cleanest possible signal of workforce developments. National Academies of Sciences, Engineering, and Medicine, “Information Technology and the U.S. Workforce”; Jeffrey R. Young, “Artificial Intelligence Could Help Colleges Better Plan What Courses They Should Offer,” EdSurge, December 8, 2016, available at https://www.edsurge.com/news/2016-12-08-artificial-intelligence-could-help-colleges-better-plan-what-courses-they-should-offer.
- Lauren Caldwell, “Open Government Data Fuels Private Sector Innovation: Data Jams, Hackathons and Datapaloozas,” SAIS Review of International Affairs, March 12, 2014, available at http://www.saisreview.org/2014/03/12/open-government-data-fuels-private-sector-innovation-data-jams-hackathons-and-datapaloozas.
- National Academies of Sciences, Engineering, and Medicine, “Information Technology and the U.S. Workforce.”
- “The Open Skills Project is a public-private partnership lead (sic) by the University of Chicago focused on providing a dynamic, up-to-date, locally-relevant, and normalized taxonomy of skills and jobs that builds on and expands on the Department of Labor’s O*NET data resources.” See Data at Work, “Open Skills Project,” available at http://dataatwork.org/data (last accessed May 2017); see also the Center for Open Data Enterprise, “Open Data for the Labor Market.”
- As many economists have noted, labor market information has many characteristics of a public good. See Council of Economic Advisers, Active Labor Market Policies: Theory and Evidence for What Works; David Autor, “Introduction to ‘Studies of Labor Market Intermediation’”; see also Woods and O’Leary, “Conceptual Framework for an Optimal Labour Market Information System: Final Report.”
- Albert Rees, “Information Networks in Labor Markets,” The American Economic Review 56 (1/2) (1966): 559–566.
- Weiser, “Entrepreneurial Administration.”
The positions of American Progress, and our policy experts, are independent, and the findings and conclusions presented are those of American Progress alone. A full list of supporters is available here. American Progress would like to acknowledge the many generous supporters who make our work possible.