NTIA Government Master File of Federal Frequency Assignments

drdispatch

What's the frequency, Kenneth?
Premium Subscriber
Joined
Feb 17, 2007
Messages
1,349
Location
Fightin' River, Michigan
In the spirit of me having way too much time on my hands, I am now working to make a custom Google map with pins for all listings in the NTIA document.

Why?

Bc I'm a college student with too much free time and too much interest in finding patterns, that's why.
You're scaring me...:oops:
 

KE5ZBG

NMSAR
Premium Subscriber
Joined
Jun 22, 2015
Messages
138
Location
New Mexico
Update on trying to convert the entire document into a excel workbook.:

currently only on page 16 out of the 15,000 or so. Will try to push through the rest of them, shouldn't take me more than a month to compile them all.

Also, I've been running the coordinates through a little coordinates to address converter to make sure they are correct.

Proof:

NTIA Unclassified Frequency Master List --- - Copy.xlsx
It seemed like a number of the coordinates I checked were off inconsistently, by varying degrees. (eg. not a consistent shift)

Does NTIA use the same Datum as the FCC?
 

ecps92

Member
Joined
Jul 8, 2002
Messages
14,925
Location
Taxachusetts
Do you have an example? as many that I have checked have been SPOT on....

It seemed like a number of the coordinates I checked were off inconsistently, by varying degrees. (eg. not a consistent shift)

Does NTIA use the same Datum as the FCC?
 

wa8pyr

Technischer Guru
Staff member
Lead Database Admin
Joined
Sep 22, 2002
Messages
7,249
Location
Ohio
It would be nice if someone with some programming skills could parse this into an Excel workbook file.

Or better yet a searchable database; of course, if it got parsed into an Excel spreadsheet, importing into a searchable database would be easy-peasy.

Not going to be me; that would definitely be a time-consuming project. If someone were to parse it into Excel I'd be glad to whip together a quick database, though.
 

batdude

Florida Db Admin / Florida Forum Moderator
Moderator
Joined
Jul 29, 2002
Messages
1,603
Location
East Central, Florida
the funniest thing about the entire document is page 3.

I literally have an email from "KATHY SMITH" who tells me that she has no idea what the "Government Master File" is.

hilarious.

btw - there is another angle here. Keep in mind --- I do NOT have access to the classified version of this document.

I have been told that the entire GMF is "Confidential" - and (last I checked) - unless there is a really good reason, you can request a de-classification review of a Confidential document +10 years after it was created. This is the angle I tried with Kathy Smith who told me there were no such thing as a Government Master File (SMH)..... (I specifically requested the entire 2010 GMF....)

anyway.

The TSM article by Chris Parris mentions that the entire GMF is "Top Secret" - I highly doubt that is true, but I have no facts to counter his words.
My best guess would be that the entire GMF is actually a SECRET document. This would allow it to be processed via standard classified computer channels (e.g., SIPRNet, etc.) - as the requirements for a TS level network are quite restrictive. Again, I have no real world experience to offer on the matter. Just my guess.

Should you want to give yourself a headache, read: The President Executive Order 13526

The hangup has and always will be classification. Since various feeders into the GMF, especially military, can classify listings for whatever reason - location, freq, usage, etc. it will always make for a tricky document to request a de-classification review, especially when listings could reveal military capabilities / locations that are indeed "classified".

All that being said - I think it's pretty neat that at least NTIA released "something".


doug
 

Larry51

Member
Premium Subscriber
Joined
Sep 2, 2005
Messages
302
Location
Chesapeake, VA
the funniest thing about the entire document is page 3.

I literally have an email from "KATHY SMITH" who tells me that she has no idea what the "Government Master File" is.

hilarious.

btw - there is another angle here. Keep in mind --- I do NOT have access to the classified version of this document.

I have been told that the entire GMF is "Confidential" - and (last I checked) - unless there is a really good reason, you can request a de-classification review of a Confidential document +10 years after it was created. This is the angle I tried with Kathy Smith who told me there were no such thing as a Government Master File (SMH)..... (I specifically requested the entire 2010 GMF....)

anyway.

The TSM article by Chris Parris mentions that the entire GMF is "Top Secret" - I highly doubt that is true, but I have no facts to counter his words.
My best guess would be that the entire GMF is actually a SECRET document. This would allow it to be processed via standard classified computer channels (e.g., SIPRNet, etc.) - as the requirements for a TS level network are quite restrictive. Again, I have no real world experience to offer on the matter. Just my guess.

Should you want to give yourself a headache, read: The President Executive Order 13526

The hangup has and always will be classification. Since various feeders into the GMF, especially military, can classify listings for whatever reason - location, freq, usage, etc. it will always make for a tricky document to request a de-classification review, especially when listings could reveal military capabilities / locations that are indeed "classified".

All that being said - I think it's pretty neat that at least NTIA released "something".


doug
I had access to and used the GMF from the mid 1970s when it was on microfiche through the 1980s and early 1990s when it was published on a CD-ROM. The overall classification was SECRET because some of the individual military and CIA entries were classified at that level and had "(S)" prior to their listing. The federal law enforcement agencies were classified at the CONFIDENTIAL level. Nothing in the database was at the TS level.
 

blantonl

Founder and CEO
Staff member
Super Moderator
Joined
Dec 9, 2000
Messages
11,269
Location
San Antonio, Whitefish, New Orleans
When the NTIA releases an RFP to pull that master database off the mainframe into a super-duper client-server RDBMS environment, I'm going to bid on the project for $212 million dollars, get the contract, and I'll disappear for a few years to do the conversion.

The next time you'll see me is on a beach somewhere in flip-flops, swim trunks, and a Philippe Patek watch on my wrist.
 

ChrisP

Member
Premium Subscriber
Joined
May 20, 2002
Messages
1,356
Location
Portland, OR
The TSM article by Chris Parris mentions that the entire GMF is "Top Secret"
Doug, I could have been a little clearer - there was a federal contract job posting that mentioned the applicant must be able to hold a "TOP SECRET" security clearance in order to have access to the GMF and other information as part of the federal job.

- Chris
 

krokus

Member
Premium Subscriber
Joined
Jun 9, 2006
Messages
6,136
Location
Southeastern Michigan
The TSM article by Chris Parris mentions that the entire GMF is "Top Secret" - I highly doubt that is true, but I have no facts to counter his words.
It has been a few years, but the freq coordinators used to be a few desks over from my desk. They had a copy of the database, and it was not that highly classified.
 

krokus

Member
Premium Subscriber
Joined
Jun 9, 2006
Messages
6,136
Location
Southeastern Michigan
When the NTIA releases an RFP to pull that master database off the mainframe into a super-duper client-server RDBMS environment, I'm going to bid on the project for $212 million dollars, get the contract, and I'll disappear for a few years to do the conversion.

The next time you'll see me is on a beach somewhere in flip-flops, swim trunks, and a Philippe Patek watch on my wrist.
So who would you turn over the operations of this site to? (Assuming you would not disavow this site.)
 

crowleyd102

Member
Premium Subscriber
Joined
Jun 11, 2003
Messages
99
Location
St. Louis
It's based on the 80-column punched card format, with certain columns dedicated to certain fields. Check
"MANUAL OF REGULATIONS AND PROCEDURES FOR FEDERAL RADIO FREQUENCY MANAGEMENT" for more info. The whole NTIA file can be converted to a relational database with some good old-fashioned COBOL, FORTRAN, or C programming and some hard work.
 

drdispatch

What's the frequency, Kenneth?
Premium Subscriber
Joined
Feb 17, 2007
Messages
1,349
Location
Fightin' River, Michigan
It's based on the 80-column punched card format, with certain columns dedicated to certain fields. Check
"MANUAL OF REGULATIONS AND PROCEDURES FOR FEDERAL RADIO FREQUENCY MANAGEMENT" for more info. The whole NTIA file can be converted to a relational database with some good old-fashioned COBOL, FORTRAN, or C programming and some hard work.
(Refer to picture in post #62.)

"FORTRAN.... Now that's a name I haven't heard in a long time.......... A long time."
- OWK
(With apologies to Mr. Lucas.)
 

AM909

Radio/computer geek
Premium Subscriber
Joined
Dec 10, 2015
Messages
1,311
Location
SoCal
The problem is that the conversion to PDF screwed up some of the column alignment, inconsistently, and the conversion back to text is therefore inconsistent. It becomes far more complex to parse by looking for known values in approximate positions.
 

crowleyd102

Member
Premium Subscriber
Joined
Jun 11, 2003
Messages
99
Location
St. Louis
The problem is that the conversion to PDF screwed up some of the column alignment, inconsistently, and the conversion back to text is therefore inconsistent. It becomes far more complex to parse by looking for known values in approximate positions.
I understand your point. All of you posting on this issue are doing great work. In the 1980s, I devoted a year to transcribing all the Missouri listings from the Prelinger microfiche by hand to columnar pads, hoping someday to convert to Excel. Now ArkTex is doing it with this latest release.
 
Top