EDT: Frequently Asked Questions
What is EMS?
The Environmental Monitoring System (EMS) is a data repository. The system was designed to capture data results from physical /chemical, biological and toxicological analyses performed on water, air, solid waste discharges and ambient monitoring throughout the province as well as related quality assurance data. Samples are collected by ministry staff and permittees under the Environmental Management Act and analyzed by public and private laboratories.
The system also provides an efficient means by which analytical laboratories and permit holders can transfer monitoring data electronically into the EMS database.
Who do I contact to find out more about sending data electronically to EMS?
All permittees and private laboratories wishing to submit data to EMS electronically should direct their questions to the regional ministry contact or the EMS Helpdesk. These support resources will be able to answer any questions, provide relevant background information and documentation, and/or provide immediate general assistance. Private Laboratories providing analytical services for several permittees should contact the ministry, at: EMSHelp@gov.bc.ca
How do I send my data to EMS electronically?
EMS supports these data file transfer options. Users submitting data electronically to EMS may choose any one of the following alternatives:
- Recommended for use by Electronic Data Providers submitting small to medium sized datasets. The recommended file size when using this option is 150K or less;
- Includes an option to submit an ASCII file to EMS using supported formats; and
- Data is loaded into EMS immediately.
FTP (File Transfer Protocol)
- More likely to be used by laboratories transmitting larger datasets on a regular basis
- Files are transmitted directly to an EMS directory using FTP (File Transfer Protocol)
- Can be programmed by data providers to automate data transfer on a regular basis
- The data is loaded into EMS hourly
What hardware/software do I need to submit data to EMS electronically?
All data providers submitting data to EMS electronically must have a computer with Internet access and have access to an e-mail account. This will enable EMS to communicate directly with the data provider.
I'd like to transfer my data to EMS electronically. What is the best option for me to use?
The best option is to get your analyzing agency to upload this information on your behalf as most of the laboratories have automated most of this process. The choice of which option to choose for sending data will generally be dependent on the size and frequency of the files being transferred. Permittees who are required to submit large datasets on a regular basis may decide to use the FTP option, whereas permittees who are required to submit small datasets on an infrequent basis may decide to use web submission. Whatever option is selected, the data provider should inform their local ministry contact of the preferred data transfer method. The ministry will then arrange to provide you with a userid and password.
The EMS EDT Guidelines and Responsibilities document includes three file formats, which one should I use?
All new electronic data providers must use the standard EMS file format. Permittees who are required to report under the Pulp and Paper Single Window Data Reporting must use the revised FPP format.
How do I know my file format is correct and accepted by EMS?
All new EDT users must use the standard EMS file format. The correct file format is detailed in the EMS Electronic Data Transfer Guidelines and Responsibilities document.
In addition, all initial file transfers for new data providers must first be performed in the EMS training environment to ensure there are no file format problems. If format problems exist, an error message indicating the problems will be sent by EMS to the data provider and the regional ministry contact.
The data provider must correct any file format problems and re-send the file to the training environment. Once a file has been successfully transferred in the training environment, the data provider will be advised to transfer the file(s) to the EMS production version.
I submitted a file to EMS electronically, how do I know EMS received the data?
When EMS receives a data file, the system processes the file, generates a Quality Assurance (QA) index/error report and sends a copy of the report to both the data provider and the local regional ministry contact via e-mail. This report will indicate the results of the data processed. These reports will be sent as follows:
Web Submission Options
- All data submitted via the web submission will be processed immediately and an e-mail containing the QA index and/or error report will be sent to the data provider and the local ministry contact by return e-mail.
- Data files submitted using FTP will be processed hourly. An e-mail indicating the QA index and/or error report will be sent to the data provider and the local ministry contact by e-mail within the hour.
How secure is the data I am sending to EMS?
The EMS helpdesk will assign unique EDT userids and passwords for all data providers using the Web Submission or FTP option. To arrange for a userid and password, see your local regional ministry contact or contact the EMS Helpdesk. Once assigned, passwords will not expire and will only be changed at the request of the data provider. It is the data provider's responsibility to properly safeguard the userid and password assigned to them.
If the data provider suspects there may be a breach of security (e.g. if they receive any inappropriate data transfer messages) they should notify their regional ministry contact immediately. Receipt of such messages could indicate a possible security breach.
Where can I get a listing of EMS codes?
Data providers can obtain a copy of valid EMS codes from the list of EMS Support Tables available on our Internet web site.
What is the Quality Assurance (QA) Index?
The EMS QA Index is based on an algorithm developed to indicate a basic level of scientific confidence associated with a specific dataset. The QA Index is not intended to indicate 'good' or 'bad' data or whether permit related data is in compliance, e.g.:
- QA index of 'C' indicates the data passed all EMS calculation and validation checks.
- QA index of 'F' indicates the data failed one or more of EMS calculation or validation checks. An error report will be generated for all data with a QA index of 'F' indicating why the data received a value of 'F'.
EMS allows the user to submit the data for QA index calculation only. This should normally be done to review any possible errors in the dataset before formally submitting the data to EMS. The user is informed via e-mail of any ERRORS or WARNINGS associated with the data. If corrections are necessary, the data must be corrected by the user and the file resubmitted for entry into EMS. Once entered into the EMS database, the data provider can no longer modify the data.
Files submitted to EMS with a 'QA index only' option are not actually loaded into EMS. Such files need to be subsequently re-sent for actual transfer to EMS.
I received a mail message indicating there were errors in my data. Who is responsible for correcting those errors?
EMS generated QA index/error reports may contain two types of messages: ERROR and WARNING messages.
If ERRORS are found in the dataset (e.g. mandatory fields left blank or invalid codes used), EMS will prefix the record with an ERROR message. If ERROR messages are reported in the QA index/error report, the entire file will be rejected by EMS. The data must then be corrected by the data provider and the entire file resubmitted to EMS.
Records prefixed with a WARNING message indicate that the data was accepted by EMS but that the record failed one or more systems validation checks and therefore received a "lower" QA index. Once data has been accepted by EMS, data correction is restricted to ministry staff. This is why it is preferred that all files are submitted for QA index prior to a final upload.
If the error report contains both ERROR and WARNING messages, the data provider will still be able to correct all of the data as EMS will have rejected the entire data file.
What do I do if I discover an error in the data after it was submitted to EMS?
EMS will generate QA index/and error reports after the data has been processed. A copy the QA index/error reports will be sent to data submitter and the ministry Regional contact.
If ERRORS are found in the dataset (e.g. mandatory fields left blank or invalid codes used):
the entire file will be rejected by EMS. All data corrections must be made by the data provider and the corrected file resubmitted to EMS.
If the data is accepted by EMS, but fails one or more of the system's validation checks (i.e. generates WARNING messages):
- the data has been entered into EMS and can only be corrected by ministry staff. Data providers must notify the ministry contact and request the necessary changes.
If all data is accepted by EMS, passes the EMS validations checks, but is subsequently found to contain ERRORS:
- Correction of EMS data is restricted to ministry staff. Data providers must notify the ministry contact and request the necessary changes.
I received a mail message indicating there were errors in my data. How do I go about finding out what those errors mean?
We have produced a detailed EDT Error Message Interpretation page on this site. Please review this listing for an interpretation of your error message. If the error message you received is not included on this list, contact the EMS helpdesk.
I submitted a file to EMS via Web Submission. What do I do if I haven't received a QA index/error report e-mail after a hour has passed?
Try uploading the data again. If you still have not received confirmation, contact the EMS Helpdesk. The helpdesk will investigate the problem and advise you when the problem has been resolved.