Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
100 changes: 100 additions & 0 deletions gdcv2_doc_drafts/clinical_data_analysis.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,100 @@
# Clinical Data Analysis

The Clinical Data Analysis tool allows for a set of customizable charts to be generated for a set of clinical attributes. Users can select which clinical fields they want to display and visualize the data using various supported plot types. The clinical analysis features include:

* Ability to select which clinical fields to display
* Examine the clinical data of each field using these visualizations:
* Histogram
* Survival Plot
* Create custom bins for each field and re-visualize the data with those bins
* Select specific cases from a clinical field and use them to create a new set, or modify/remove from an existing set
* Download the visualizations of each plot type for each variable in SVG or PNG
* Download the data table of each field in JSON or TSV format
* Print all clinical variable cards in the analysis with their active plot to a single PDF

## Enabling Clinical Variable Cards
<font color='red'>Step by step instructions - or add a screenshot from the button</font>
* On the Analysis page, click the arrow on *Clinical Data Analysis*.

* On the Analysis page, use the control panel on the left side of the analysis to display which clinical variables you want. To enable or disable specific variables for display, click the on/off toggle controls:

[![Enable Clinical Cards](images/ClinicalCards.png)](images/ClinicalCards.png "Click to see the full image.")

The clinical fields are grouped into these categories:

* __Demographic:__ Data for the characterization of the patient by means of segmenting the population (e.g. characterization by age, sex, race, etc.).
* __Diagnoses:__ Data from the investigation, analysis, and recognition of the presence and nature of the disease, condition, or injury from expressed signs and symptoms; also, the scientific determination of any kind; the concise results of such an investigation.
* __Treatments:__ Records of the administration and intention of therapeutic agents provided to a patient to alter the course of a pathologic process.
* __Exposures:__ Clinically-relevant patient information not immediately resulting from genetic predispositions.

## Exploring Clinical Card Visualizations

Users can explore different visualizations for each clinical field they have enabled for display. Each card supports histograms and survival plots. To switch between plot types, click the different plot type icons in the top-right of each card.

### Histogram

The histogram plot type supports these features:

* View the distribution of cases (# and % of cases) in the cohort for the clinical field's data categories as a histogram
* View the distribution of cases in tabular format
* Select the cases for specific data categories to create new sets, append to existing sets, or remove from existing sets
* Download the histogram visualization in SVG or PNG format
* Download the raw data used to generate the histogram in JSON format

[![Histograms](images/Histograms.png)](images/Histograms.png "Click to see the full image.")

Note that the histogram plot applies to, and can be displayed for, both categorical and continuous variables.

### Survival Plot

The survival plot type supports these features:

* View the distribution of cases (# and % of cases) in the cohort for the clinical field's data categories as a table.
* Select and plot the survival analysis for the cases of specific data categories in the table:
* By default the top 2 categories (highest # of cases) are displayed.
* Users can manually select and plot up to 5 categories at a time.
* Download the survival plot visualization in SVG or PNG format
* Download the raw data used to generate the survival plot in JSON or TSV format <font color='red'> NO JSON BUTTON - coming soon</font>

[![Clinical Analysis Survival Plot](images/CDAsurvival.png)](images/CDAsurvival.png "Click to see the full image.")

Note that the survival plot applies to, and can be displayed for, both categorical and continuous variables.

## Creating Custom Bins

For each clinical variable, whether categorical or continuous, users can create custom bins to group the data in ways they find scientifically interesting or significant. Once saved, the bins are applied to these visualizations and they are then re-rendered:

* Histogram and associated data table
* Survival plot and associated data table

Custom bins can be reset to their defaults at any time for each card. Note that custom bins are __saved per analysis__.

### Categorical Binning

To create custom bins for a categorical variable, click *__Customize Bins__*, then *__Edit Bins__*. A configuration window appears where the user can create their bins:

[![Histogram Binning](images/HistogramBinning.png)](images/HistogramBinning.png "Click to see the full image.")

The user can:

* Group existing individual values into a single group
* Give a custom name to each group
* Ungroup previously grouped values
* Completely hide values from being shown in the visualization
* Re-show previously hidden values

### Continuous Binning

To create custom bins for a continuous variable, click *__Customize Bins__*, then *__Edit Bins__*. A configuration window appears where the user can create their bins:

[![Clinical Analysis Continuous Bins](images/CDAcontinuousbins.png)](images/CDAcontinuousbins.png "Click to see the full image.")

The user can choose one of these continuous binning methods:

* (1) Create equidistant bins based on a set interval:
* User must choose the interval (e.g. equidistant bins of 1,825 days for the Age of Diagnosis field)
* User can optionally define the starting and ending value between which the equidistant bins will be created
* (2) Create completely custom ranges:
* User manually enters 1 or more bins with custom ranges
* User must enter a name for each range and the start and end values
* The ranges can be of different interval lengths
16 changes: 16 additions & 0 deletions gdcv2_doc_drafts/oncogrid.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
# OncoGrid

Oncogrid displays cases and mutated genes using a grid-style graphic. Each column represents a case and each row represents a gene. The color and shape that are displayed at each intersection represent the presence/absence, type, and impact of mutations that are found in that gene for the associated case. Mutation frequency and CNV frequency are both displayed alongside each row and column, while clinical attributes are displayed alongside each column.

[![OncoGrid](images/OncoGrid.png)](images/OncoGrid.png "Click to see the full image.")

A toolbar at the top right of the graphic allows the user to export the data as a JSON object, PNG image, or SVG image. Seven buttons are available in this toolbar:

* __Customize Colors:__ Users can customize the colors that represent mutation consequence types and CNV gains/losses.
* __Download:__ Users can choose to export the contents either to a static image file (PNG or SVG format) or the underlying data in JSON format.
* __Reload Grid:__ Sets all OncoGrid rows, columns, and zoom levels back to their initial positions.
* __Cluster Data:__ Clusters the rows and columns to place mutated genes with the same cases and cases with the same mutated genes together. <font color=red> Some details suggested. Clicking the button doesn't make any visible change</font>
* __Toggle Heatmap View:__ The view can be toggled between cells representing mutation consequences or the number of mutations in each gene.
* __Toggle Gridlines:__ Turn the gridlines on and off.
* __Toggle Crosshairs:__ Turns crosshairs on, so that users can zoom into specific sections of the OncoGrid.
* __Fullscreen:__ Turns Fullscreen mode on/off.
95 changes: 95 additions & 0 deletions gdcv2_doc_drafts/repository.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,95 @@
# Repository

## Introduction ##

The Repository tool is where the files associated with each case in the current cohort can be browsed and downloaded. It also offers users a variety of file filters for identifying files of interest.

The Repository tool can be reached in one of these two ways:
* choosing the Repository link in the GDC Data Portal header or on the home page <font color=red>General note: Since the buttons have no words, I strongly recommend an **exact verbiage match** (and wherever possible a description of the icon) between help documents and tooltips. </font>
* clicking the play button on the Repository card in the Analysis Center

[![Repository In Header](images/RepositoryInHeader.png)](images/RepositoryInHeader.png "Click to see the full image.")


## Choosing a Cohort ##

When searching for files to download, many users will have in mind a specific cohort whose associated files they wish to download. The set of files displayed in the Repository at any time will reflect the files that are associated with the active cohort. The current active cohort can be seen in the main toolbar {{LINK TO QUICK START, MAIN TOOLBAR}} and can be changed by clicking the name of the cohort and choosing a new one from the dropdown menu. If the cohort of interest does not appear in the list, try [creating a new cohort.](http://www.LINK-TO-COHORT-PAGE.gov)

For users who want to browse all files that are available at the GDC, **choose the “All GDC” cohort.**

## Filtering a Set of Files ##

Users may only be interested in browsing through or downloading a subset of files associated with the current cohort. For this purpose, a set of commonly-used default facet cards is provided in the left panel of the Repository tool to allow users to filter the files presented in the table on the right:

* **Data Category**: A high-level data file category, such as "Raw Sequencing Data" or "Transcriptome Profiling".
* **Data Type**: Data file type, such as "Aligned Reads" or "Gene Expression Quantification". Data Type is more granular than Data Category.
* **Experimental Strategy**: Experimental strategies used for molecular characterization of the cancer.
* **Workflow Type**: Bioinformatics workflow used to generate or harmonize the data file.
* **Data Format**: Format of the data file.
* **Platform**: Technological platform on which experimental data was produced.
* **Access**: Indicator of whether access to the data file is open or controlled.

Values within each facet can be sorted alphabetically by choosing the “AZ” button on the top left of each card. Alternatively, the frequency sort button next to the "Files" labeled may be selected to sort the values by the number of files available.

Note that the categories displayed in the filters represent the values available for the active cohort<font color=red> See MS Word notes</font>. If the active cohort is the default "All GDC" cohort, then the categories displayed represent the values available for the entire GDC.

[![Full Repository](images/FullRepo.png)](images/FullRepo.png "Click to see the full image.")

If a different filter needs to be used, a custom filter can be applied by choosing the “Add a File Filter” button at the top of the default filters. Each custom filter can then be searched and chosen within the pop-up window. Once a custom filter is selected, a new filter card will appear at the top of the default filters. Custom filters can be removed from the Repository by choosing the X at the top right of each filter card.

[![Custom File Filter](images/CustomFileFilter.png)](images/CustomFileFilter.png "Click to see the full image.")

## Downloading a Set of Files ##

When filtering has been completed, files are ready to be downloaded. Depending on the number and size of files, the GDC has several options and recommendations for downloading them. While any amount of data can be downloaded using the GDC Data Transfer Tool or the API, files can be downloaded directly from the Data Portal if the size is less than 5 GB in total and the number of files is less than 10,000. For any downloads larger than 5 GB or 10,000 files, it’s recommended that the download be performed using the [GDC Data Transfer Tool](https://gdc.cancer.gov/access-data/gdc-data-transfer-tool).

### Adding Files to the Cart for Download ####

To perform a download, first, add a set of files to the Cart. This can be done using the following methods:
* Adding individual file(s) using the cart icon at the left of each file in the table.
* (Coming Soon!) Selecting the Add All Files to Cart button. This will add all the files in the current cohort to the Cart, subject to any filtering that has been applied in the Repository.

[![Add Files To Cart](images/AddFilesToCart.png)](images/AddAllFilesToCart.png "Click to see the full image.")

### Cart - Overview

The Cart page can then be reached by clicking the Cart icon at the top right of the portal.

At the upper-right of the page is a summary of all files currently in the cart:
* Number of files.
* Number of cases associated with the files.
* Total file size.

The Cart page displays the file count by project and authorization level, as well as a table of all files that have been added to the Cart. Files can be removed from the Cart using the trash icons at the left of each file in the table or by selecting the "Remove from Cart" option at the top of the Cart page, which removes either all files or the unauthorized ones.

[![Cart Page](images/CartPage.png)](images/CartPage.png "Click to see the full image.")

### Cart Items Table

The Cart Items table shows the list of all the files that were added to the Cart. The table gives the following information for each file in the cart:

* **Access**: Displays whether the file is open or controlled access. Users must login to the GDC Portal and have the appropriate credentials to access these files.
* **File Name**: Name of the file. Clicking the link will bring the user to the File Summary Page.
* **Cases**: The number of cases associated with the file.
* **Project**: The Project that the file belongs to. Clicking the link will bring the user to the Project Summary Page.
* **Data Category**: Type of data.
* **Data Format**: The file format.
* **File Size**: The size of the file.
* **Annotations**: Whether there are any annotations.


### Downloading Files from the Cart

To download files in the Cart, select the Download Cart button and choose either:
* Manifest: Downloads a manifest for the files that can be passed to the GDC Data Transfer Tool. A manifest file contains a list of the UUIDs that correspond to the files in the cart.
* Cart: Download the files directly through the browser. Users have to be cautious of the amount of data in the cart since this option will not optimize bandwidth and will not provide resume capabilities. This option can only be used if the total size of the files in the Cart does not exceed 5 GB.

### Additional Data Download

Additional data can be downloaded from the Cart page using the Download Associated Data button at the top of the page and choosing one of the available options.

[![Cart Metadata](images/CartAssociatedData.png)](images/CartAssociatedData.png "Click to see the full image.")
* Clinical: TSV / Clinical: JSON - This includes all clinical information from the cases that are associated with the files (available as TSV or JSON)
* Biospecimen: TSV / Biospecimen: JSON - This includes all biospecimen information from the cases that are associated with the files (available as TSV or JSON).
* Sample Sheet - A TSV with commonly-used elements associated with each file, such as sample barcode and sample type.
* Metadata - This includes all of the metadata associated with each and every file in the cart. Note that this file is only available in JSON format and may take several minutes to download.