Congressional Correspondence Metadata Documentation

Author

Devin Judge-Lord

1. Overview

This dataset combines congressional correspondence, inquiries, casework, referrals, and related metadata received from approximately 100 federal agencies, offices, commissions, and government-related entities.

The merged dataset contains records from multiple source systems. Because agencies used different correspondence management systems, exported files contain many overlapping fields with different names. After merging, the dataset contains 700+ raw metadata columns, many of which represent the same or similar concepts.

Examples include:

  • DATE, Date Received, Receive Date, Received.Date, DATEREC
  • FROM, From, Correspondent, Constituent, Originator
  • SUBJECT, Subject, Issue, Topic, Description
  • Control, Control Number, Control No., Case Number, Tracking Id
  • Due, Due Date, Date Due, Suspense Date, Response Due Date

For a list of all fields see Section 9.

To support analysis, the project preserves raw fields while creating a documented crosswalk from agency-specific source columns to standardized canonical variables.


2. Dataset

Each row represents one correspondence-related record as provided by a source agency, such as

  • Congressional inquiry
  • Constituent casework referral
  • Oversight or policy correspondence
  • Request for information

3. Source Agencies

The dataset includes records from agencies such as:

  • ABMC
  • Amtrak
  • CNCS
  • CSOSA
  • DHHS subagencies
  • DHS subagencies
  • DOC subagencies
  • DOD subagencies
  • DOE subagencies
  • DOI subagencies
  • DOJ subagencies
  • DOL subagencies
  • DOT subagencies
  • ED
  • EEOC
  • EPA
  • FCC
  • FTC
  • HUD
  • NASA
  • SSA
  • Treasury subagencies
  • USDA subagencies
  • USPS
  • VA

The agency column identifies the source agency or subagency for each record.


4. Core Fields Present Across Most Agencies

Several standardized fields appear near-universally in the merged file. These should be treated as core dataset-level identifiers and metadata.

Field Description
agency Source agency or subagency acronym.
ID Unique record-level agency identifier, where present, otherwise the row number in the datasheet.
DATE May be the letter date or received date depending on the agency (where we have both, we use the letter date).
FROM Sender/correspondent field, often copied or collated from other columns (unfortunately, sometimes the original field was overwritten in earlier data).1
data_id Legislator-letter-level unique within-agency id
icpsr ICPSR legislator identifier, where matched.
bioname Biographical Directory name for member of Congress, where matched.
congress Congress number associated with the member or record.
chamber Congressional chamber, usually House or Senate.
state_abbrev State abbreviation associated with the member.
district_code House district code, where applicable.
LetterID Id for each letter or record, corresponding to multiple data_ids when more than one legislator signed a letter
year Year extracted from date.
department Parent department or agency group.

5. Raw Metadata Columns

The merged dataset includes 700+ raw metadata fields. These fields were retained to preserve the original source information from agency FOIA responses.

Raw fields include:

  • Source identifiers
  • Case numbers
  • Control numbers
  • Tracking numbers
  • Received dates
  • Due dates
  • Closed dates
  • Response dates
  • Routing information
  • Staff assignments
  • Congressional offices
  • Committees
  • Subject, topic, or issue fields
  • Correspondent and constituent fields
  • Notes/status fields
  • Document type and correspondence type fields
  • Agency-specific workflow fields

For a list of all fields see Section 9.

Many raw fields are sparse because they only apply to one agency or one export format.


6. Metadata Coverage Counts

A field coverage table vars_by_agency.csv provides counts non-missing values for each metadata column within each agency.

Each row in the coverage table represents one agency.

Each column after agency represents a metadata field.

Each cell contains:

The number of records for that agency where the field is not missing.

For example:

agency ID DATE FROM SUBJECT
ABMC 87 87 87 87
Amtrak 1571 1571 1571 0
DHHS_CMS 69938 69938 69938 69937

Interpretation:

  • A count of 0 means the field is absent or fully missing for that agency.
  • A count equal to the agency row count means the field is populated for all records from that agency.
  • Partial counts indicate incomplete coverage.

7. Field Consolidation Strategy

Because many fields represent the same concept under different names, the project uses a crosswalk table to map raw agency-specific fields to canonical variables.

The guiding principle is:

Preserve all raw source fields, but create standardized canonical fields for analysis.

This allows analysts to:

  1. Use harmonized variables where possible.
  2. Trace every standardized value back to its source column.
  3. Retain agency-specific fields for auditing or specialized analysis.
  4. Avoid irreversible data loss during cleaning.

8. Data Fields by Type

8.1 Record and Source Identifiers

Canonical field Description Example raw source fields
agency Source agency/subagency. agency
department Parent department or broader agency family. department, inferred from agency prefix
source_file_id Internal file/source identifier. data_id, source, Source
record_id_raw Original source-system record ID. ID, Id, Doc ID, Document ID, CaseID, FolderID
record_id_project Project-generated unique row/record identifier. LetterID, generated UUID
control_number Agency control, tracking, or correspondence number. Control, Control Number, Control No., Control.No., CNTL NO, OSD CNTL NO., NIST Control Number, DL.Control.Number
case_number Case-specific identifier. Case Number, CaseNumber, CaseID, CaseName, Case Type, CaseType
tracking_number Tracking or workflow identifier. Tracking Id U, 11 Tracking Number, LOGNUMBER, WebDocFlow ID, VIEWS Number, VAIQ Number

8.2 Dates

Canonical field Description Example raw source fields
date_record Primary standardized date for the record. DATE, date, Date, Record Date, Created Date
date_received Date received by agency. Date Received, Received Date, Receive Date, Received.Date, DATEREC, DATE RECEIVED, Date Rec, Date.Received
date_correspondence Date on original letter/correspondence. Correspondence Date, Date on Correspondence, Date on Letter, DateonLetter, Doc Date
date_assigned Date assigned/routed internally. Assigned Date, Assign Date, Date Assigned, assignment_date, Date Inquiry Assigned
date_due Due date or suspense date. Due, Due Date, DATEDUE, DATE DUE, Date Due, DUEDATE, Suspense Date, Response Due Date, Members Due Date
date_answered Date agency answered or replied. Date Answered, Answer Date, Answer.Date, Date of Reply, Date of Reply/Contact, Date Responded, Response Date
date_closed Date record closed. Date Closed, Closed Date, Close Date, Date.Closed, date.closed, Closing Date, CloseDate, Final Date
date_signed Date final response was signed. Date Signed, Signed Date, Final Signed Date, DateSigned, Signed.Date
date_modified Date record was last modified. Last Modified Date, Modified On, Updated.On, Updated On

8.3 Congressional Member Metadata

Fields from voteview.com or used to link to voteview data

Canonical field Description Example raw source fields
member_icpsr ICPSR member identifier. icpsr
member_bioname Member name from Biographical Directory. bioname
member_first_name Member first name. first_name, First Name, First.Name, AUTHOR.FIRST.NAME
member_last_name Member last name. last_name, Last Name, Last.Name, AUTHOR.LAST.NAME
member_chamber House or Senate. chamber, Senate.Or.House, Senate or House
member_district Congressional district. district_code, District, Place_District
member_state State abbreviation. state_abbrev
congress Congress number. congress
member_or_committee Member, committee, or office name. Member of Congress, Member/Committee (HOR), Member/Committee (Senate), Primary Member of Congress, Congressional Office

Additional fields about committees and staff

Canonical field Description Example raw source fields
committee_name Congressional committee. Committee, Committees, Primary Committee, Committee/Organization
subcommittee_name Subcommittee. SubCommittee To Inquiry
congressional_staff Congressional staff contact. Congressional Staff, Inquiring staff name, staffer, staff

8.4 Correspondent / Sender / Recipient

Canonical field Description Example raw source fields
sender_name Person or organization sending the correspondence. FROM, From, Correspondent, Constituent, Constituent.Name, Originator, Recipient
sender_first_name Sender first name. From First Name, First_Name, First Name, Additional Contacts: First Name
sender_last_name Sender last name. From Last Name, Last_Name, Last Name, Additional Contacts: Last Name
sender_organization Sender organization. Organization, Organization Name, Constituent/org name, Account Name: Account Name, Org
sender_type Type/class of correspondent. CONSTITUENT_TYPE, CONSTITUENT_CLASS, Correspondent Type, Contact_Type _Name, Contact Category, Requestor Type
recipient_name Addressee or recipient. TO, To, Addressee, ADDRESSED TO, Addressed To, Agency Recipient
recipient_office Office or agency recipient. Office Assigned, Action Agency, Liable Office, Office Handling the Response
contact_method Method of contact. Contact Method, Communication Type, Communication.Type, Type of Response Mail, Email, Phone Call, Request sent by SPS...
address_city Addressee city. Addressee City, City
address_state Addressee state. Addressee State, State
address_zip Addressee ZIP code. Addressee Zip Code, ZIP

8.5 Subject, Issue, Topic, and Policy Metadata

Canonical field Description Example raw source fields
subject Main subject/title/description. SUBJECT, Subject, Specific Subject, Title, Document Title, Description, Description of Inquiry
issue Issue category. Issue, issue, Primary Inquiry Issue, Primary Inquiry Sub-Issue, Secondary Inquiry Issue, Sub_Issue
topic Topic classification. Topic, Category, Query Category, Archival Category
subject_state State abbreviation. State, Property.State, Place_State

Hand-coded subject and related fields (hand-coded files are in all caps)

Canonical field Description Example raw source fields
policy_event Standardized policy event indicator. POLICY_EVENT, nPE
event_name Name of event. EVENT_NAME, EVENT
event_date Date of event. EVENT_DATE, Event Date, Action Date
document_type Type of document/correspondence. Document Type, Doc. Type, Doc..Type, DOC TYPE, Correspondence Type, Correspondence\nType, Corr. Type
correspondence_type Broad correspondence category. TYPE, Type, Item Type, Inquiry Type, INQUIRY TYPE, Case Type, call.letter.memo.email
alt_type Alternative or secondary type. ALT_TYPE, ALT.TYPE, nALT_TYPE
certainty Classification certainty. CERTAINTY, nCERT

8.6 Workflow, Assignment, and Status

Canonical field Description Example raw source fields
status Current or final status. Status, status, Current Status, Status Reason, Tasker.Status, Record Status, Location Status
status_date Date associated with status. statusdate, Status Update, Last.Action
assigned_to Person or office assigned. Assigned To, Assigned to, Assignee To, Assignee: Full Name, User Assigned, Assigned PA, AssignedOPR
assigned_office Office assigned. Action Office, Action.Office, ActionOffice, LeadOffice, Lead IC/Office, Responsible Office/Individual, Office of Primary Responsibility
coordinator Coordinator or lead. Coordinator, Policy Coordinator, OCR Staff, OGR Lead, CNCS Staff Lead
priority Priority or urgency. Priority, Prority, PRIORITY, Sensitive, Special Attention
action_required Required action. Action Required, Action, ACTION, ACTIONS, Action Code, Type of Action Required, Actions Required
response_required Whether a response was required. Response Required? (1), Reply Type (Action assigned)
final_disposition Final action/disposition. Final, Final Action/Disposition Date, Action Taken, PRC Action Taken

8.7 Notes and Free Text

Canonical field Description Example raw source fields
NOTES General notes from hand coders. NOTES
notes General notes from agency staff. Notes, notes, Notes/Status, TICKETNOTE, Remarks, Comments, Additional Notes, Special Instructions
error_flag Processing or classification error flag. ERROR
ocr_text OCR or extracted text. text_clean, raw
file_name File name. file_name, file
file_path File path. Path
url URL or link. url, link_text

9 All Data Fields

Below is a list of fields in the data by agency, prior to standardization. As noted above, some are from the agency’s tracking system and some were introduced in the OCR, cleaning, or coding process.

Code
library(readr)
library(dplyr)
library(tidyr)
library(stringr)

# -----------------------------
# Input / output files
# -----------------------------
input_file <- here::here("vars_by_agency.csv")

output_summary <- "agency_specific_fields.csv"
output_counts  <- "agency_specific_fields_with_counts.csv"
output_single  <- "single_agency_fields.csv"
output_subset  <- "subset_specific_fields.csv"

# -----------------------------
# Read coverage table
# -----------------------------
coverage <- read_csv(input_file, show_col_types = FALSE)

agency_col <- "agency"

if (!agency_col %in% names(coverage)) {
  stop("Expected an 'agency' column in the coverage table.")
}

# -----------------------------
# Helper: detect placeholder/import artifact columns
# -----------------------------
is_placeholder_field <- function(x) {
  x_norm <- x |>
    str_replace_all("\u00a0", " ") |>
    str_trim()

  x_lower <- str_to_lower(x_norm)

  str_detect(x_lower, "^x\\d+$") |      # X1, X32, x17
    str_detect(x_lower, "^\\.\\.\\.\\d+$") | # ...21, ...36
    str_detect(x_lower, "^field\\d+$") |     # Field1, Field2
    str_detect(x_lower, "^blank$") |         # Blank
    str_detect(x_lower, "^s$") |             # s
    str_detect(x_lower, "^n$") |             # n
    str_detect(x_lower, "^nn$")              # nn
}

# -----------------------------
# Convert to long format
# -----------------------------
coverage_long <- coverage |>
  pivot_longer(
    cols = -all_of(agency_col),
    names_to = "raw_field",
    values_to = "non_missing_count"
  ) |>
  mutate(
    non_missing_count = suppressWarnings(as.numeric(non_missing_count)),
    non_missing_count = replace_na(non_missing_count, 0),
    is_placeholder = is_placeholder_field(raw_field)
  ) |>
  filter(!is_placeholder)

# -----------------------------
# Count number of agencies
# -----------------------------
n_agencies <- coverage |>
  distinct(.data[[agency_col]]) |>
  nrow()

# -----------------------------
# Create agency/subset-specific field summary
# -----------------------------
agency_specific_fields <- coverage_long |>
  group_by(raw_field) |>
  summarise(
    n_agencies_with_data = sum(non_missing_count > 0),
    agencies_with_data = paste(
      .data[[agency_col]][non_missing_count > 0],
      collapse = "; "
    ),
    total_non_missing = sum(non_missing_count),
    .groups = "drop"
  ) |>
  filter(
    n_agencies_with_data > 0,
    n_agencies_with_data < n_agencies
  ) |>
  arrange(n_agencies_with_data, raw_field)

# -----------------------------
# Write summary table
# -----------------------------
write_csv(agency_specific_fields, output_summary)

# agency_specific_fields
Code
fields_to_keep <- agency_specific_fields$raw_field

agency_specific_counts <- coverage |>
  select(all_of(agency_col), all_of(fields_to_keep)) |>
  pivot_longer(
    cols = -all_of(agency_col),
    names_to = "raw_field",
    values_to = "non_missing_count"
  ) |>
  mutate(
    non_missing_count = suppressWarnings(as.numeric(non_missing_count)),
    non_missing_count = replace_na(non_missing_count, 0)
  ) |>
  pivot_wider(
    names_from = all_of(agency_col),
    values_from = non_missing_count
  ) |>
  left_join(
    agency_specific_fields |>
      select(raw_field, n_agencies_with_data, total_non_missing),
    by = "raw_field"
  ) |>
  relocate(
    raw_field,
    n_agencies_with_data,
    total_non_missing
  ) |>
  arrange(n_agencies_with_data, raw_field)

write_csv(agency_specific_counts, output_counts)

# agency_specific_counts
Code
library(knitr)

markdown_table <- agency_specific_fields |>
  filter(n_agencies_with_data<40) |> 
  arrange(agencies_with_data) |> 
  mutate(raw_field = str_squish(raw_field) |> str_replace_all("  ", " ")) |> 
  kable(format = "markdown")

markdown_table
raw_field n_agencies_with_data agencies_with_data total_non_missing
Date Answered 1 ABMC 83
Query Category 1 ABMC 87
Query Type 1 ABMC 87
Source 1 ABMC 87
Title 3 ABMC; CNCS; DHHS_CDC 10709
Item Type 4 ABMC; DHS_ICE; EOP_USTR; Treasury_OCC 7572
Date Received 6 ABMC; DOI_NIGC; DOL_OCIA; EOP_CEQ; NCPC; VA_CEM 280
Assigned To 1 Amtrak 127
CType 1 Amtrak 127
Cust Rel 1 Amtrak 1444
Final 1 Amtrak 1571
Signature 1 Amtrak 127
dateoriginal 1 Amtrak 1571
Status 22 Amtrak; CNCS; DHHS_ACF; DHHS_CDC; DHHS_CMS; DHHS_FDA; DHHS_IHS; DHHS_SAMHSA; DOJ_CIV; DOJ_EOIR; DOJ_USMS; DOL_OCIA; DOL_OSHA; EOP_USTR; FHFA; TVA; Treasury_IRS; USDA; USDA_FS; USDA_NRCS; USDA_RMA; VA 213210
State 4 Amtrak; CNCS; FCC; PRC 8175
Category 6 Amtrak; DHHS_CMS; DHS_ICE; DOD_USACE; DOJ_ENRD; PRC 4084
Constituent 12 Amtrak; DOC_OS; DOD_DLA_Aviation; DOD_OIG; DOE_FERC; DOL_ETA; DOL_MSHA; DOL_OCFO; DOL_OSHA; FTC; NARA; VA 134435
Control 3 Amtrak; DOD_OIG; DOT_PHMSA 4194
Due 2 Amtrak; FTC 14079
CNCS Staff Lead 1 CNCS 36
Constituent/org name 1 CNCS 17
District 1 CNCS 10
Inquiring staff contact 1 CNCS 20
Inquiring staff name 1 CNCS 34
Last Contact 1 CNCS 9
Notes/Status 1 CNCS 33
OGR Lead 1 CNCS 40
Out 1 CNCS 1300
Type 7 CNCS; DOC_OS; DOD_OIG; DOI_OSMRE; DOL_OSHA; NASA; PRC 7546
tempDATE 5 CNCS; DOL_MSHA; DOT_FHWA; FHFA; USDA 10777
Additional Action 1 CSOSA 3
Date of Reply/Contact 1 CSOSA 130
Office Handling the Response 1 CSOSA 125
Official Handling the Response 1 CSOSA 121
Other 1 CSOSA 136
Reference 1 CSOSA 136
Action 7 CSOSA; DHHS_ACL; DHHS_CDC; DHHS_FDA; DOC_MBDA; DOD_USACE; EEOC 28469
Addressee 16 CSOSA; DHHS_CDC; DHHS_NIH; DOL_ETA; DOL_MSHA; DOL_OASAM; DOL_OCFO; DOL_OCIA; DOL_OFCCP; DOL_OSHA; DOL_OWCP; DOL_SOL; DOL_VETS; USDA; USDA_FS; USDA_NRCS 75812
Document Type 3 CSOSA; DOT_FRA; USDA_NRCS 3880
Processing Code 2 CSOSA; USDA_NRCS 1406
Date Closed 1 DHHS_ACF 722
Action Required 3 DHHS_ACF; DHHS_CMS; DHHS_SAMHSA 53393
Sort 12 DHHS_ACF; DHHS_FDA; DHHS_SAMHSA; DOC_EDA; DOD_OIG; DOL_OSHA; DOT_FHWA; DOT_FTA; DOT_PHMSA; FHFA; SSA; Treasury_IRS 53264
Assigned Due Date 2 DHHS_ACF; DHHS_SAMHSA 2132
Doc ID 2 DHHS_ACF; DHHS_SAMHSA 2470
Policy Coordinator 2 DHHS_ACF; DHHS_SAMHSA 2437
Refd. To 2 DHHS_ACF; DHHS_SAMHSA 2369
Committees 1 DHHS_ACL 127
Request sent by SPS, email (E) mail (M), Phone Call (P) 1 DHHS_ACL 130
Type of Response Mail, Email, Phone Call 1 DHHS_ACL 129
Response Date 2 DHHS_ACL; DOI_NIGC 137
Assigned to 2 DHHS_ACL; VA 91904
Account Name: Account Name 1 DHHS_CDC 4968
Action.Office 1 DHHS_CDC 6639
Activator Case Number 1 DHHS_CDC 857
Additional Contact Name 1 DHHS_CDC 1243
Additional Contacts: First Name 1 DHHS_CDC 1243
Additional Contacts: Last Name 1 DHHS_CDC 803
Affiliation 1 DHHS_CDC 11590
Answer Date 1 DHHS_CDC 5247
Answer.Date 1 DHHS_CDC 9115
Assignee: Full Name 1 DHHS_CDC 2357
Case Origin 1 DHHS_CDC 2370
Case Owner: Full Name 1 DHHS_CDC 2485
Communication Type 1 DHHS_CDC 5247
Communication.Type 1 DHHS_CDC 5247
Contact Name 1 DHHS_CDC 2483
Created By: Full Name 1 DHHS_CDC 2485
Date/Time Closed 1 DHHS_CDC 2461
FolderID 1 DHHS_CDC 5247
HHS Reference Number 1 DHHS_CDC 1863
Last Modified By: Full Name 1 DHHS_CDC 2485
Last Modified Date 1 DHHS_CDC 2485
Location Status 1 DHHS_CDC 5247
Program 1 DHHS_CDC 4968
Program Due Date 1 DHHS_CDC 5247
Program.Due.Date 1 DHHS_CDC 5247
Prority 1 DHHS_CDC 7732
Receive Date 1 DHHS_CDC 7730
Receive.Date 1 DHHS_CDC 8454
Referrer Ref Number 1 DHHS_CDC 5247
Referrer.Due.Date 1 DHHS_CDC 5247
Referrer.Ref.Number 1 DHHS_CDC 5788
Reply Type (Action assigned) 1 DHHS_CDC 4968
Sensitive 1 DHHS_CDC 4968
Action Office 6 DHHS_CDC; DHHS_CMS; DHHS_HRSA; DOC_OS; DOI_OSMRE; HUD_HQ 137268
Created Date 2 DHHS_CDC; DHHS_IHS 1927
Close.Date 2 DHHS_CDC; FCC 13789
Sub Type 2 DHHS_CDC; PRC 607
Referrer 3 DHHS_CDC; USDA_FS; USDA_NRCS 6293
Referrer Due Date 2 DHHS_CDC; USDA_NRCS 5248
Coordinator 1 DHHS_CMS 50968
Date to CMS 1 DHHS_CMS 18229
From First Name 1 DHHS_CMS 50968
From Last Name 1 DHHS_CMS 50968
Last Task Deadline 1 DHHS_CMS 50968
Workspace 1 DHHS_CMS 50968
Document ID 2 DHHS_CMS; DHHS_HRSA 74350
Organization 17 DHHS_CMS; DHHS_HRSA; DOI_BOEM; DOI_NPS; DOL_ETA; DOL_MSHA; DOL_OASAM; DOL_OCFO; DOL_OCIA; DOL_OFCCP; DOL_OSHA; DOL_OWCP; DOL_SOL; DOL_VETS; DOT_FHWA; DOT_FTA; EEOC 114554
Sig Level 2 DHHS_CMS; DHHS_SAMHSA 728
Date Signed 6 DHHS_CMS; DOL_OCFO; NLRB; Treasury_OCC; USDA; VA_CEM 21018
Corr. Type 1 DHHS_FDA 1329
ID other 1 DHHS_FDA 1329
Keywords 1 DHHS_FDA 1274
Recd / Create Date 1 DHHS_FDA 1329
ToOrgAbbr 1 DHHS_FDA 12820
statusdate 1 DHHS_FDA 12812
Priority 3 DHHS_FDA; DOD_USACE; TVA 1984
Due Date 12 DHHS_FDA; DOI_OSMRE; DOI_SOL; DOI_USGS; DOL_ETA; DOL_OASAM; DOL_OCFO; DOL_OCIA; DOL_OFCCP; DOL_OSHA; EOP_USTR; Treasury_IRS 33755
Action Code 1 DHHS_HRSA 4412
Assign Date 1 DHHS_IHS 15
Communication 1 DHHS_IHS 1405
Created By 1 DHHS_IHS 1278
Event Date 1 DHHS_IHS 1391
Processed By 1 DHHS_IHS 941
Sub- number 1 DHHS_IHS 1404
Case Number 4 DHHS_IHS; NARA; TVA; Treasury_IRS 26637
Assigned PA 1 DHHS_NIH 299
Assignment Type 1 DHHS_NIH 299
Control No. 1 DHHS_NIH 8050
DHHS/OS Control No. 1 DHHS_NIH 3233
Doc. Type 1 DHHS_NIH 7750
Lead IC/Office 1 DHHS_NIH 284
Date Completed 3 DHHS_NIH; DOC_NIST; Treasury_OCC 1587
DATE_orgingal 1 DHHS_SAMHSA 1746
nALT_TYPE 1 DHS_HQ 40559
nCERT 1 DHS_HQ 40559
nNOTES 1 DHS_HQ 40559
nPE 1 DHS_HQ 40559
nTYPE 1 DHS_HQ 40559
nWF 1 DHS_HQ 40559
originalWF 1 DHS_HQ 40559
subagency 1 DHS_HQ 40559
originalDATE 6 DHS_HQ; DOD_USACE; DOJ_CIV; DOT_FTA; ED; SSA 55707
FROM2 2 DHS_HQ; DOI_NPS 44848
originalDATE2 2 DHS_HQ; DOI_NPS 45100
WF 2 DHS_HQ; DOJ_ENRD 41253
DATE2 2 DHS_HQ; NLRB 40924
SUBJECT2 2 DHS_HQ; SSA 44769
Call Log Type 1 DHS_ICE 1274
Member/Committee (HOR) 1 DHS_ICE 1948
Member/Committee (Senate) 1 DHS_ICE 1948
OCR Staff 1 DHS_ICE 1281
Other Contacts 1 DHS_ICE 7
Staff First & Last Name 1 DHS_ICE 1277
enforcement 1 DHS_ICE 99
CONSTITUENT_TYPE 4 DHS_ICE; DHS_USCIS; DHS_USCIS_2016; Treasury_IRS 269602
Notes 2 DHS_ICE; DOE_FERC 1084
Path 2 DHS_ICE; Treasury_OCC 2568
Business Unit (Owning User) (User) 1 DHS_USCIS 116248
Closed On 1 DHS_USCIS 116435
Committee Staff To Inquiry 1 DHS_USCIS 14
Congressional Staff 1 DHS_USCIS 114253
Contact Method 1 DHS_USCIS 116444
Inquiry Number 1 DHS_USCIS 116444
Inquiry Type 1 DHS_USCIS 116444
Primary Committee 1 DHS_USCIS 15
Primary Inquiry Issue 1 DHS_USCIS 116439
Primary Inquiry Sub-Issue 1 DHS_USCIS 116427
Primary Member of Congress 1 DHS_USCIS 116429
Secondary Inquiry Issue 1 DHS_USCIS 24005
Secondary Inquiry Sub-Issue 1 DHS_USCIS 20050
Received Date 4 DHS_USCIS; DHS_USCIS_2016; HUD_HQ; Treasury_IRS 360998
Form Type 1 DHS_USCIS_2016 144459
Topic 1 DHS_USCIS_2016 32966
USCIS_ID 1 DHS_USCIS_2016 171638
combined 1 DHS_USCIS_2016 144459
combined2 1 DHS_USCIS_2016 32966
Subject 7 DHS_USCIS_2016; DOD_OIG; DOI_OSMRE; DOJ_USMS; DOL_ETA; VA; VA_CEM 272008
Office 6 DHS_USCIS_2016; DOI_USGS; DOL_EBSA; EEOC; EOP_USTR; USDA_RMA 35863
Closed Date 3 DHS_USCIS_2016; DOI_USGS; HUD_HQ 228562
Issue 2 DHS_USCIS_2016; PRC 172006
due 1 DOC_EDA 1076
folder 1 DOC_EDA 1070
staff 1 DOC_EDA 1067
to 1 DOC_EDA 1087
control 4 DOC_EDA; DOC_MBDA; DOD_OSDJS; DOT_FAA 15344
AFFILIATN 1 DOC_NIST 216
Action By 1 DOC_NIST 258
Agent 1 DOC_NIST 256
BC 1 DOC_NIST 201
BYWHOM 1 DOC_NIST 408
COMPLETED 1 DOC_NIST 425
DATEDUE 1 DOC_NIST 431
DATEREC 1 DOC_NIST 215
DATESENT 1 DOC_NIST 400
Date Sent to ExecSec 1 DOC_NIST 214
INSTRUCTN 1 DOC_NIST 213
LOGNUMBER 1 DOC_NIST 224
NIST Control Number 1 DOC_NIST 258
NOCOSIGNER 1 DOC_NIST 4
PRIORITY 1 DOC_NIST 204
REPLYDATE 1 DOC_NIST 216
SALUTATION 1 DOC_NIST 199
SENTTO 1 DOC_NIST 222
SIGNATURE 1 DOC_NIST 215
TICKETNOTE 1 DOC_NIST 61
WebDocFlow ID 1 DOC_NIST 203
toANDfrom 1 DOC_NIST 236
ACTION 2 DOC_NIST; SSA 4371
TO 2 DOC_NIST; USDA_NIFA 95
DUEDATE 1 DOC_NOAA 466
Tracking Id U 1 DOC_NOAA 466
sort 5 DOC_NOAA; DOL_OSHA; DOL_OWCP; NLRB; SSA 17594
Close_Compl ete_Date 1 DOC_NTIA 36
Contact_Type _Name 1 DOC_NTIA 38
Date_Created 1 DOC_NTIA 234
Document_Ty pe_Name 1 DOC_NTIA 35
First_Name 1 DOC_NTIA 38
Full_Address 1 DOC_NTIA 32
Last_Name 1 DOC_NTIA 38
Organization Name 1 DOC_NTIA 37
Task_Description 1 DOC_NTIA 37
ACTION TYPE 1 DOC_OCPA 90
ACTIONS 1 DOC_OCPA 44
ADDITIONAL NOTES 1 DOC_OCPA 29
DATE DUE 1 DOC_OCPA 13
STATUS 1 DOC_OCPA 68
staffer 1 DOC_OCPA 68
stafferCONTACT_INFO 1 DOC_OCPA 57
11 Tracking Number 1 DOC_OS 979
Assignee To 1 DOC_OS 1827
CLOSE 1 DOC_OS 919
Current Status 1 DOC_OS 977
Date Due to Originator 1 DOC_OS 1841
Division 1 DOC_OS 836
Extension Date 1 DOC_OS 335
CaseType 1 DOC_SBA 5583
LeadOffice 1 DOC_SBA 5583
Sent 1 DOC_SBA 1336
ControlNumber 4 DOC_SBA; DOT_FTA; NASA; USDA_RMA 12895
CaseNumber 2 DOC_SBA; NLRB 6100
INQUIRY TYPE 1 DOD_DFAS 758
DUE DATE 3 DOD_DFAS; DOI_NIGC; Treasury_Mint 2572
DL.Control.Number 1 DOD_DLA_Aviation 273
OPR 1 DOD_DLA_Aviation 273
date.closed 1 DOD_DLA_Aviation 243
type.of.contact 1 DOD_DLA_Aviation 266
ACT OFC 1 DOD_DeCA 30
CAT 1 DOD_DeCA 30
CMSY 1 DOD_DeCA 336
CNTL NO 1 DOD_DeCA 741
CONSTITUENT 1 DOD_DeCA 643
DAYS CLOSE 1 DOD_DeCA 540
OSD CNTL NO. 1 DOD_DeCA 406
Reply 1 DOD_DeCA 705
string 1 DOD_DeCA 717
FROMoriginal 1 DOD_Navy 4706
Tasker.Status 1 DOD_Navy 5607
DCN 3 DOD_Navy; DOI_BIA; DOI_SOL 6454
DATEoriginal 6 DOD_Navy; DOI_USGS; DOL_MSHA; EOP_USTR; NLRB; USDA_RMA 25737
AIG 1 DOD_OIG 2318
Final Date 1 DOD_OIG 2327
Initial Resp. Date 1 DOD_OIG 385
Last Interim Date 1 DOD_OIG 1341
Record Date 1 DOD_OIG 2304
Suspense Date 1 DOD_OIG 2059
powellType 1 DOD_OSDJS 1999
(Do Not Modify) Modified On 1 DOD_USACE 534
(Do Not Modify) Row Checksum 1 DOD_USACE 534
(Do Not Modify) Tasker 1 DOD_USACE 534
AssignedOPR 1 DOD_USACE 610
AssignedOPRSuspense 1 DOD_USACE 777
CompletedDate 1 DOD_USACE 710
Origin 1 DOD_USACE 534
Owner 1 DOD_USACE 837
Role 1 DOD_USACE 534
Status Reason 1 DOD_USACE 534
AntiBusiness 1 DOE_FERC 1867
AntiProject 1 DOE_FERC 1723
AntiSide 1 DOE_FERC 1307
CC_House 1 DOE_FERC 130
CC_Senate 1 DOE_FERC 61
Case_Name 1 DOE_FERC 332
Case_Proceeding 1 DOE_FERC 1656
Cosigned_House 1 DOE_FERC 2312
Cosigned_Senate 1 DOE_FERC 1783
FERC_LetterID 1 DOE_FERC 6820
Freelancer 1 DOE_FERC 6799
Other_CC 1 DOE_FERC 1282
Place_City 1 DOE_FERC 1434
Place_District 1 DOE_FERC 4597
Place_State 1 DOE_FERC 3380
ProBusiness 1 DOE_FERC 1021
ProProject 1 DOE_FERC 1287
ProSide 1 DOE_FERC 1513
availability 1 DOE_FERC 6820
docket 1 DOE_FERC 5861
file_name 1 DOE_FERC 6820
filed_date 1 DOE_FERC 6820
link_text 1 DOE_FERC 6820
missed 1 DOE_FERC 6820
rowname 1 DOE_FERC 6799
text_clean 1 DOE_FERC 4422
url 1 DOE_FERC 6820
Input Date 1 DOI_BIA 657
Congressional Office 1 DOI_BSEE 93
Reply date 1 DOI_BSEE 81
To 2 DOI_BSEE; NWTRB 400
Responsible Office/Individual 1 DOI_NIGC 9
Control # 2 DOI_NIGC; EEOC 19709
Response Type 2 DOI_NIGC; VA_CEM 26
Closed.Date 1 DOI_NPS 4063
Cong..State 1 DOI_NPS 4129
Doc..Type 1 DOI_NPS 4541
In.Out 1 DOI_NPS 4541
Orig..Office 1 DOI_NPS 4541
Received.Date 1 DOI_NPS 2306
Signed.Date 1 DOI_NPS 2895
X.1 1 DOI_NPS 4541
X.2 1 DOI_NPS 4541
originalDATE1 1 DOI_NPS 4538
X 2 DOI_NPS; SSA 7470
Action Type 1 DOI_OSMRE 62
Begin Date 1 DOI_OSMRE 63
Correspondenc e Date 1 DOI_OSMRE 63
Due To Director 1 DOI_OSMRE 49
Sent From 1 DOI_OSMRE 63
Sent To 1 DOI_OSMRE 63
Signed 1 DOI_OSMRE 47
Comments 5 DOI_OSMRE; DOI_USGS; DOJ_CIV; VA; VA_CEM 100731
Received 3 DOI_OSMRE; EPA; SSA 15692
Author 2 DOI_OSMRE; USDA_NRCS 1237
Assigned 2 DOI_OSMRE; VA_CEM 86
Orig. Office 1 DOI_SOL 138
Salutation 2 DOI_SOL; DOI_USGS 237
Docket 1 DOI_USGS 261
Last Name 2 DOI_USGS; PRC 664
Created.By 1 DOJ_CIV 439
Created.On 1 DOJ_CIV 439
Date.Response.Due 1 DOJ_CIV 1778
Ex.Sec.No 1 DOJ_CIV 2330
First.Name 1 DOJ_CIV 2351
Id 1 DOJ_CIV 1169
Last.Name 1 DOJ_CIV 2352
Senate or House 1 DOJ_CIV 182
Senate.Or.House 1 DOJ_CIV 532
Special.Project 1 DOJ_CIV 469
Unit.Responding 1 DOJ_CIV 1878
Updated.By 1 DOJ_CIV 359
Updated.On 1 DOJ_CIV 359
From 2 DOJ_CIV; PRC 2737
Date.Closed 2 DOJ_CIV; SSA 7336
DATE_CLOSED 1 DOJ_ENRD 699
DUE 1 DOJ_ENRD 699
WFs 1 DOJ_ENRD 694
FOLDER 1 DOJ_EOIR 1331
Service ID 2 DOJ_EOIR; DOJ_USMS 1490
DATE RECEIVED 2 DOJ_EOIR; USDA_NIFA 1465
ADDRESSED TO 1 DOJ_FBI 4870
INCOMING DATE 1 DOJ_FBI 4870
Record Number 1 DOJ_FBI 4871
Close Date 1 DOJ_USMS 159
Date Rec 1 DOJ_USMS 159
Doc Date 1 DOJ_USMS 155
Open Date 1 DOJ_USMS 159
Primary Contact 1 DOJ_USMS 159
Service Code 1 DOJ_USMS 159
Description 2 DOJ_USMS; NARA 9824
# Inq Subject 1 DOL_EBSA 10142
Closing Date 1 DOL_EBSA 10081
Final Signature 7 DOL_ETA; DOL_OASAM; DOL_OCFO; DOL_OCIA; DOL_OFCCP; DOL_OSHA; DOL_VETS 13801
SIMS ID 6 DOL_ETA; DOL_OCIA; DOL_OSHA; DOL_OWCP; DOL_SOL; DOL_VETS 82776
Date Entered 2 DOL_ETA; DOL_VETS 10223
Originator 2 DOL_ETA; Treasury_OCC 10462
DueDate 1 DOL_MSHA 1257
FinalSignature 1 DOL_MSHA 1217
SIMS ID Originator Organization Addressee Subject Final Signature Date Entered Due Date f; 1 DOL_OASAM 407
Action Agency 2 DOL_OCIA; DOL_OSHA 2011
Office Assigned 3 DOL_OCIA; DOL_OWCP; DOL_VETS 12227
Final Signed Date 2 DOL_OCIA; DOL_VETS 1118
Controlling Agency 1 DOL_OSHA 3
Links to Press release (if applicable) 1 DOL_OWCP 6
Close Out Date 2 DOL_OWCP; DOL_VETS 12069
Record Status 1 DOL_SOL 28662
Correspondence Date 1 DOL_VETS 990
Letter Type Code 1 DOL_VETS 924
Remarks 1 DOL_VETS 726
Signature Level Code 1 DOL_VETS 1037
originaldate 1 DOL_VETS 1037
Special Instructions 2 DOL_VETS; USDA_NRCS 91
assigned 2 DOT_FAA; VA 104246
ActionOffice 2 DOT_FHWA; DOT_SLSDC 2674
Control Number 2 DOT_FHWA; USDA_NRCS 13005
CaseID 1 DOT_FRA 3329
CloseDate 1 DOT_FRA 3182
Contact Category 1 DOT_FRA 859
Office of Primary Responsibility 1 DOT_FRA 817
Org 2 DOT_FRA; FTC 15943
Address 2 DOT_FRA; NCPC 2268
Position 2 DOT_FRA; USDA_ERS 2366
FName 1 DOT_FTA 2284
LName 1 DOT_FTA 2284
raw 1 ED 4747
Addressee City 1 EEOC 19700
Addressee State 1 EEOC 19700
Addressee Street 1 1 EEOC 19700
Addressee Street 2 1 EEOC 19700
Addressee Street 3 1 EEOC 19700
Addressee Zip Code 1 EEOC 19700
Correspondent Type 1 EEOC 19700
Date of Reply 1 EEOC 19700
Amountof letters sent out? 1 EOP_CEQ 1
Date Responded 1 EOP_CEQ 2
Response Required? (1) 1 EOP_CEQ 296
Response on Shared Drive 1 EOP_CEQ 3
Type of Response 1 EOP_CEQ 73
User Assigned 1 EOP_CEQ 588
Agreement 1 EOP_USTR 4585
Code 1 EOP_USTR 3908
Date of response 1 EOP_USTR 4174
Deputy 1 EOP_USTR 407
Modified By 1 EOP_USTR 4865
Signatory 1 EOP_USTR 3733
Status Update (FO Use Only) 1 EOP_USTR 527
Status1 1 EOP_USTR 4856
Correspondence Type 2 EOP_USTR; NASA 5019
Recipient 2 EOP_USTR; NASA 8730
Control.No. 1 EPA 11476
Last.Action 1 EPA 11473
originalDate 1 EPA 11476
status 2 EPA; VA 103250
2 1 FCA 127
CongressionalInquiry 1 FCA 120
Strategic.Plan.Goal.1 1 FCC 6158
date 1 FCC 6248
party 1 FCC 6158
CCN 1 FHFA 3365
Modified O 1 FHFA 3123
Modified by 1 FHFA 155
SYSTEM 1 FHFA 3232
Completed 1 FTC 13594
Ref No 1 FTC 13689
Type of Action Required 1 FTC 816
Addressed To 1 HUD_HQ 56673
Correspondent 1 HUD_HQ 56673
Date on Correspondence 1 HUD_HQ 56673
Folder ID 1 HUD_HQ 56673
Contact 1 NARA 9798
Date 1 NARA 9802
Liable Office 1 NARA 9799
Member of Congress 1 NARA 9803
Committee 1 NASA 685
Committee/Organization 1 NCPC 16
Final Action/Disposition Date 1 NCPC 18
NCPC File Number 1 NCPC 21
Primary Station/Staff Member 1 NCPC 21
Response Due Date 1 NCPC 12
Type of Correspondence 1 NCPC 21
DateClosed 1 NCUA 342
Letter of Receipt sent TO congressman 1 NCUA 102
Letter of close sent 1 NCUA 84
Action Taken 1 NLRB 93
Actions Required 1 NLRB 59
Add. Resp. 10 1 NLRB 2
Add. Resp. 2 1 NLRB 5
Add. Resp. 3 1 NLRB 4
Add. Resp. 4 1 NLRB 4
Add. Resp. 5 1 NLRB 4
Add. Resp. 6 1 NLRB 2
Add. Resp. 9 1 NLRB 2
Add. Resp.7 1 NLRB 2
Add. Resp.8 1 NLRB 2
Additional Responses 1 NLRB 15
Agency Recipient 1 NLRB 99
CaseName 1 NLRB 304
DATE1 1 NLRB 348
DATE3 1 NLRB 348
DATE4 1 NLRB 341
Date Requested 1 NLRB 32
DateInterimLetter 1 NLRB 367
Description of Inquiry 1 NLRB 90
Oversight 1 NLRB 9
Referred To 1 NLRB 154
Requestor Type 1 NLRB 213
Response to OGC 1 NLRB 95
ResponseDate 1 NLRB 285
source 1 NLRB 382
Date Due 2 NLRB; Treasury_OCC 1303
DR 1 NWTRB 302
Action Date 1 PRC 52
City 1 PRC 333
EVENT 1 PRC 1
First Name 1 PRC 430
No 1 PRC 444
PRC Action Taken 1 PRC 454
Product 1 PRC 405
Referral 1 PRC 4
Sub_Issue 1 PRC 448
Via 1 PRC 454
ZIP 1 PRC 297
title 1 PRC 451
ACT.Number.and.Action 1 SSA 4271
CCRS.Specialist 1 SSA 2252
CCRS.Specialist..Completion.Date 1 SSA 3879
Closed 1 SSA 4271
Comp.Clear.By 1 SSA 4149
Comp.Info.By 1 SSA 4149
Components 1 SSA 4265
Constituent.Name 1 SSA 871
Date.Due 1 SSA 4271
Date.Received 1 SSA 4266
Date.of.Referral 1 SSA 4238
Date.received..Forwarded 1 SSA 4120
Draft.By 1 SSA 4149
Follow.Up.Date…Completion.Date 1 SSA 3208
PC 1 SSA 5007
Referred.to..CMS..FO..etc. 1 SSA 4114
Referred.to..DO..ODAR..RCD…. 1 SSA 3990
SSN 1 SSA 3726
To.OEO 1 SSA 4149
WR.. 1 SSA 4272
file 1 SSA 4265
item 1 SSA 4265
person 2 SSA; VA 96039
AC.AREA 1 Treasury_Fiscal 10068
AUTHOR.FIRST.NAME 1 Treasury_Fiscal 11788
AUTHOR.LAST.NAME 1 Treasury_Fiscal 11788
CONTROL.NUMBER 1 Treasury_Fiscal 10313
Subtype 1 Treasury_Fiscal 11789
Case Type 1 Treasury_IRS 15590
Correspondence Type 1 Treasury_IRS 16172
Members Due Date 1 Treasury_IRS 7833
date1 1 Treasury_IRS 16793
extra 1 Treasury_IRS 15845
CLASS 1 Treasury_Mint 1813
DOC TYPE 1 Treasury_Mint 1813
DOCKET 1 Treasury_Mint 1813
FILE NO 1 Treasury_Mint 1813
OFFICE 1 Treasury_Mint 1813
SIGN 1 Treasury_Mint 1016
TONE 1 Treasury_Mint 1813
USER1 1 Treasury_Mint 1498
USER2 1 Treasury_Mint 1694
XREF 1 Treasury_Mint 1813
Date Assigned 1 Treasury_OCC 1130
Date Received or Meeting Date 1 Treasury_OCC 1273
Days to Completion 1 Treasury_OCC 1256
For Signature Of 1 Treasury_OCC 960
House Member 1 Treasury_OCC 1048
Interagency 1 Treasury_OCC 1204
Senator 1 Treasury_OCC 318
Specific Subject 1 Treasury_OCC 611
# Related 1 USDA 5326
Pr Code 1 USDA 5327
Final Signer 2 USDA; USDA_NRCS 5863
DATE_old 1 USDA_ARS 913
mode 1 USDA_ARS 927
Date on Letter 1 USDA_ERS 43
DATE_original 1 USDA_FS 2988
DateSigned_old 1 USDA_FS 2724
FinalSigner 1 USDA_FS 1319
FolderCreateDate 1 USDA_FS 533
PrCode 1 USDA_FS 2994
ReferenceNumber 1 USDA_FS 288
Related 1 USDA_FS 2461
VIPType 1 USDA_FS 465
DateReceived 2 USDA_FS; USDA_NRCS 1709
DateSigned 3 USDA_FS; USDA_NRCS; USDA_RMA 4885
call.letter.memo.email 1 USDA_NASS 79
Action Organization 1 USDA_NRCS 1176
Batch Number 1 USDA_NRCS 576
DateonLetter 1 USDA_NRCS 1105
Document Title 1 USDA_NRCS 94
Folder Owner 1 USDA_NRCS 1184
Interim Response Date 1 USDA_NRCS 15
Reference Number 1 USDA_NRCS 1
Related Campaign 1 USDA_NRCS 75
Special Attention 1 USDA_NRCS 8
VIP Type 1 USDA_NRCS 1025
idnumber 1 USDA_NRCS 385
FROM_old 2 USDA_NRCS; USDA_RMA 2234
ALT.TYPE 1 USDA_RD 24
Property.State 1 USDA_RD 2818
Total.Accounts.Per.Borrower 1 USDA_RD 2383
Assigned to 1 USDA_RMA 953
NEWDATE 1 USDA_RMA 767
NEWDATESIGNED 1 USDA_RMA 921
assignment_date 1 USPS 19955
assignment_type 1 USPS 19955
assignment_user 1 USPS 19955
case_status 1 USPS 19955
congress_id 1 USPS 19955
date_closed 1 USPS 19955
date_due_final 1 USPS 19955
date_due_writer 1 USPS 19955
date_primary 1 USPS 19955
date_stamped 1 USPS 19955
decontrol 1 USPS 19955
epmg_case_id 1 USPS 19955
interim 1 USPS 19955
jacket_id 1 USPS 19955
mail_type 1 USPS 19955
sent_to_pmg 1 USPS 19955
sign_code 1 USPS 19955
CLR 1 VA 107407
Date Inquiry Assigned 1 VA 107406
Date Inquiry Entered 1 VA 91774
Date Letter Assign’d 1 VA 91774
Issue Category 1 VA 107405
VAIQ Number 1 VA 91774
VIEWS Number 1 VA 107126
issue 1 VA 91774
notes 1 VA 91774
Opened By 1 VA_CEM 23
Primary Person 1 VA_CEM 21
Responsible Office 1 VA_CEM 23
Responsible Organization 1 VA_CEM 23
Signature Level 1 VA_CEM 14
Template 1 VA_CEM 23
Code
# writeLines(
#   c(
#     "# Agency- or Subset-Specific Metadata Fields",
#     "",
#     "This table lists raw metadata fields that are populated for at least one agency but not populated for all agencies.",
#     "Placeholder or import-artifact fields such as `X1`, `X32`, and `...21` are excluded.",
#     "",
#     markdown_table
#   ),
#   "agency_specific_fields.md"
# )

Footnotes

  1. We can recover original field names from original pdfs↩︎