Eureka Cloud Analytics
Eureka Overview
Eureka ® is an analytic infrastructure service provided by Health Data Compass to quickly provision virtual machines in the Google Cloud for Compass users. Eureka instances are designed for rapid deployment so you can get started whenever you need to. If your analytic needs are dynamic we can create Eureka instances to match your analytic demands. While generic virtual machines (VMs) are easy to deploy directly on Google Cloud or any public cloud provider, Eureka virtual machines are unique in the following ways:
HIPAA Compliance
Eureka instances are preconfigured to meet the HIPAA security and compliance standards of Health Data Compass and its partners. Therefore, they are pre-approved for storage and processing of protected health information (PHI) from these organizations. These standards extend far beyond typical security controls on virtual machines.
Scalability & Affordability
Eureka instances can be scaled to be just the right size for the workload at hand. Costs scale up and down accordingly, and are charged primarily based on the amount of time a system is running. If your VMs are off in the evenings or weekends, you'll only pay for storage during those times, not for compute power. See the Eureka Cost Estimator.
Various Analytic Capabilities
Eureka offers different analytic environments to meet your needs. You can get up to 3 different VMs with Eureka App VM and you can get high performance computing with Eureka HPC. Learn more about the various Eureka offerings below.
Eureka App VM
Each instance comes with a unique GCP project that includes:
App VM (sized to your order)
OS is Ubuntu 22.04.4 (Jammy Jellyfish)
Useful applications pre-installed, such as Jupyter Notebook and R Studio
Custom URL for web-based log in to App VM
Limited internet access from App VM
Nightly back ups of VM images
High Performance Computing (HPC) can be enabled on these instances:
Batch job execution is controlled via "slurm" command
Ephemeral VMs (compute nodes) are spun up based on requirements of the job
Data Access
There are three types of data sources with which Compass Users may interact from within Eureka:
1) Data that Compass has custom delivered to a Compass User using a Compass-managed GBQ data mart
2) Data that the Compass User has brought into Eureka via a Compass Persistent Storage project
3) Publicly available datasets Google offers on Google BigQuery. These datasets include Medicare, genomics, weather data, and more. (See the latest list here.)
Eureka Billing
Compass Users pay for their actual Eureka costs and Compass support services on a quarterly basis. Payment is set up at the time of the creation for each of your Eureka instances and Compass Persistent Storage projects. Changes to your payment method can be made by contacting Compass directly here.
You can track your Eureka usage by running 'Reports' available to you on the Google Billing Console (from within your Eureka instance) or you can request an update on your usage from Compass here.
Getting Started
Complete the following steps to obtain a new Eureka instance or Compass Persistent Storage project. Once your request has been completed you will get a confirmation email along with further access instructions.
Request a new Eureka instance to Compass via e-mail here and include the following details:
Name of the Eureka Instance Owner. This individual must have reviewed and completed the Eureka Instance Owner Agreement.
Type of project (Eureka App-VM, Eureka HPC, Compass Persistent Storage) needed.
Analytic tool(s) available in Eureka that you will use.
Compute and storage requirements. These differ depending on the type of Eureka instance being requested.
App-VM: CPUs, RAM, local storage and number of VMs needed (max is 3). Please use the Eureka Price Estimator to determine your requirements and share a screenshot of your final configurations to Compass.
HPC: Attached storage size.
NOTE: consider that, while storage can be increased later, it cannot be decreased. As such, costs can be reduced by starting small and increasing as necessary.
GBQ data mart name(s) delivered by Compass that will be accessed in this Eureka Instance. Please include the name of the Compass Analyst who is supporting your GBQ data mart delivery.
A list of Compass Users who need access to the Eureka instance .
Note: A Compass User Account is requested to access Eureka. To obtain a Compass User Account please review and sign the Eureka User Agreement then reach out to us at healthdatacompass@ucdenver.edu.
A University Speed Type number. This is where Eureka charges will be billed to.
Request a new Compass Persistent Storage (CPS) project to Compass via e-mail here and include the following details:
Name of the Eureka Instance Owner who is responsible for the Eureka instance(s) that this CPS project will be used to support. The Eureka Instance Owner must review and sign the Compass Persistent Storage Agreement.
Name of Eureka instance(s) that the CPS project will be used to support. All Compass Users on these instances will have access to the CPS project.
A University Speed Type number. This is where the CPS project will be billed to.
Modifying Eureka Instance Resources
Changes can be made to a Eureka instance after deployment (see 'Request a new Eureka Instance' above, Step 4). Of note, local or attached storage cannot be decreased post-deployment. Please request a change to Compass via email here. An Instance Owner must be included on this communication.
Modifying Compass Users
If you would like to add or remove a user from an existing Eureka instance or Compass Persistent Storage project please request a change to Compass via email here.
No longer needing your Eureka instance or Compass Persistent Storage project?
When you are done with your Eureka instance or CPS project we can decommission your instance (email us here). Decommissioning means deleting all GCP resources associated with the Eureka instance or CPS project (e.g. App-VM, local disk, Google BigQuery, Google Cloud Storage, Cloud Source Repository). This does not impact a GBQ data mart that Compass uses for custom data requests that are accessed within the Eureka environment. Once a Eureka instance or CPS project is decommissioned there is no way to retrieve it.