Osteosarcoma (OS) is the most common primary malignant bone tumor of both children and pet canines. Its characteristic genomic instability and complexity coupled with the dearth of knowledge about its etiology has made improvement in the current treatment difficult. We use the existing literature about the biological pathways active in OS and combine it with the current research involving natural compounds to identify new targets and design more effective drug therapies. The key components of these pathways are modeled as a Boolean network with multiple inputs and multiple outputs. The combinatorial circuit is employed to theoretically predict the efficacies of various drugs in combination with Cryptotanshinone. We show that the action of the herbal drug, Cryptotanshinone on OS cell lines induces apoptosis by increasing sensitivity to TNF-related apoptosis-inducing ligand (TRAIL) through its multi-pronged action on STAT3, DRP1 and DR5. The Boolean framework is used to detect additional drug intervention points in the pathway that could amplify the action of Cryptotanshinone.

In this work, we develop a systematic approach for applying pathway knowledge to a multivariate Gaussian mixture model for dissecting a heterogeneous cancer tissue. The downstream transcription factors are selected as observables from available partial pathway knowledge in such a way that the subpopulations produce some differential behavior in response to the drugs selected in the upstream. For each subpopulation, each unique (drug, observable) pair is considered as a unique dimension of a multivariate Gaussian distribution. Expectation-maximization (EM) algorithm with hill-climbing is then used to rank the most probable estimates of the mixture composition based on the log-likelihood value. A major contribution of this work is to examine the efficacy of the EM based approach in estimating the composition of experimental mixture sets from cell-by-cell measurements collected on a dynamic cell imaging platform. Towards this end, we apply the algorithm on hourly data collected for two different mixture compositions of A2058, HCT116, and SW480 cell lines for three scenarios: untreated, Lapatinib-treated, and Temsirolimus-treated. Additionally, we show how this methodology can provide a basis for comparing the killing rate of different drugs for a heterogeneous cancer tissue. This obviously has important implications for designing efficient drugs for treating heterogeneous malignant tumors.

The number of deaths associated with Pancreatic Cancer has been on the rise in the United States making it an especially dreaded disease. The overall prognosis for pancreatic cancer patients continues to be grim because of the complexity of the disease at the molecular level involving the potential activation/inactivation of several diverse signaling pathways. In this paper, we first model the aberrant signaling in pancreatic cancer using a multi-fault Boolean Network. Thereafter, we theoretically evaluate the efficacy of different drug combinations by simulating this boolean network with drugs at the relevant intervention points and arrive at the most effective drug(s) to achieve cell death. The simulation results indicate that drug combinations containing Cryptotanshinone, a traditional Chinese herb derivative, result in considerably enhanced cell death. These in silico results are validated using wet lab experiments we carried out on Human Pancreatic Cancer (HPAC) cell lines.

BACKGROUND: Cancer Tissue Heterogeneity is an important consideration in cancer research as it can give insights into the causes and progression of cancer. It is known to play a significant role in cancer cell survival, growth and metastasis. Determining the compositional breakup of a heterogeneous cancer tissue can also help address the therapeutic challenges posed by heterogeneity. This necessitates a low cost, scalable algorithm to address the challenge of accurate estimation of the composition of a heterogeneous cancer tissue. METHODS: In this paper, we propose an algorithm to tackle this problem by utilizing the data of accurate, but high cost, single cell line cell-by-cell observation methods in low cost aggregate observation method for heterogeneous cancer cell mixtures to obtain their composition in a Bayesian framework. RESULTS: The algorithm is analyzed and validated using synthetic data and experimental data. The experimental data is obtained from mixtures of three separate human cancer cell lines, HCT116 (Colorectal carcinoma), A2058 (Melanoma) and SW480 (Colorectal carcinoma). CONCLUSION: The algorithm provides a low cost framework to determine the composition of heterogeneous cancer tissue which is a crucial aspect in cancer research.

Gene-expression-based phenotype classification is used for disease diagnosis and prognosis relating to treatment strategies. The present paper considers classification based on sequential measurements of multiple genes using gene regulatory network (GRN) modeling. There are two networks, original and mutated, and observations consist of trajectories of network states. The problem is to classify an observation trajectory as coming from either the original or mutated network. GRNs are modeled via probabilistic Boolean networks, which incorporate stochasticity at both the gene and network levels. Mutation affects the regulatory logic. Classification is based upon observing a trajectory of states of some given length. We characterize the Bayes classifier and find the Bayes error for a general PBN and the special case of a single Boolean network affected by random perturbations (BNp). The Bayes error is related to network sensitivity, meaning the extent of alteration in the steady-state distribution of the original network owing to mutation. Using standard methods to calculate steady-state distributions is cumbersome and sometimes impossible, so we provide an efficient algorithm and approximations. Extensive simulations are performed to study the effects of various factors, including approximation accuracy. We apply the classification procedure to a p53 BNp and a mammalian cell cycle PBN.

Tumor heterogeneity has been increasingly recognized as one of the potentially contributing factors in explaining drug resistance. In order to gain better understanding of heterogeneous cancer cell populations and different cells' responses to various drugs, we use fluorescent proteins to mark the cells and a live-cell dynamic imaging platform to collect cell-by-cell measurements. After addressing the issue of fluorescent reporter variance in a Bayesian inference framework, we decompose the different cell types in the mixture and calculate their proportions and counts over time responding to different drug treatments. Additionally, the drug response as characterized by the cell death rate was also computed for these cells, and their different sensitivity was demonstrated. Overall, this work represents an important advancement toward evaluating cancer heterogeneity and drug responses in heterogeneous cancer cell populations.

BACKGROUND: Most dynamical models for genomic networks are built upon two current methodologies, one process-based and the other based on Boolean-type networks. Both are problematic when it comes to experimental design purposes in the laboratory. The first approach requires a comprehensive knowledge of the parameters involved in all biological processes a priori, whereas the results from the second method may not have a biological correspondence and thus cannot be tested in the laboratory. Moreover, the current methods cannot readily utilize existing curated knowledge databases and do not consider uncertainty in the knowledge. Therefore, a new methodology is needed that can generate a dynamical model based on available biological data, assuming uncertainty, while the results from experimental design can be examined in the laboratory. RESULTS: We propose a new methodology for dynamical modeling of genomic networks that can utilize the interaction knowledge provided in public databases. The model assigns discrete states for physical entities, sets priorities among interactions based on information provided in the database, and updates each interaction based on associated node states. Whenever uncertainty in dynamics arises, it explores all possible outcomes. By using the proposed model, biologists can study regulation networks that are too complex for manual analysis. CONCLUSIONS: The proposed approach can be effectively used for constructing dynamical models of interaction-based genomic networks without requiring a complete knowledge of all parameters affecting the network dynamics, and thus based on a small set of available data.

This paper provides, for the first time, exact analytical expressions for the first moment of the true error of linear discriminant analysis (LDA) when the data are univariate and taken from two stochastic Gaussian processes. We assume a general setting in which the sample data from each class do not need to be identically distributed or independent within or between classes. As an application of this framework, we characterize the performance of LDA in situations that the data are generated from autoregressive models of the first order.

MOTIVATION: In early drug development, it would be beneficial to be able to identify those dynamic patterns of gene response that indicate that drugs targeting a particular gene will be likely or not to elicit the desired response. One approach would be to quantitate the degree of similarity between the responses that cells show when exposed to drugs, so that consistencies in the regulation of cellular response processes that produce success or failure can be more readily identified. RESULTS: We track drug response using fluorescent proteins as transcription activity reporters. Our basic assumption is that drugs inducing very similar alteration in transcriptional regulation will produce similar temporal trajectories on many of the reporter proteins and hence be identified as having similarities in their mechanisms of action (MOA). The main body of this work is devoted to characterizing similarity in temporal trajectories/signals. To do so, we must first identify the key points that determine mechanistic similarity between two drug responses. Directly comparing points on the two signals is unrealistic, as it cannot handle delays and speed variations on the time axis. Hence, to capture the similarities between reporter responses, we develop an alignment algorithm that is robust to noise, time delays and is able to find all the contiguous parts of signals centered about a core alignment (reflecting a core mechanism in drug response). Applying the proposed algorithm to a range of real drug experiments shows that the result agrees well with the prior drug MOA knowledge. AVAILABILITY: The R code for the RLCSS algorithm is available at http://gsp.tamu.edu/Publications/supplementary/zhao12a.

MOTIVATION: There is growing discussion in the bioinformatics community concerning overoptimism of reported results. Two approaches contributing to overoptimism in classification are (i) the reporting of results on datasets for which a proposed classification rule performs well and (ii) the comparison of multiple classification rules on a single dataset that purports to show the advantage of a certain rule. RESULTS: This article provides a careful probabilistic analysis of the second issue and the 'multiple-rule bias', resulting from choosing a classification rule having minimum estimated error on the dataset. It quantifies this bias corresponding to estimating the expected true error of the classification rule possessing minimum estimated error and it characterizes the bias from estimating the true comparative advantage of the chosen classification rule relative to the others by the estimated comparative advantage on the dataset. The analysis is applied to both synthetic and real data using a number of classification rules and error estimators. AVAILABILITY: We have implemented in C code the synthetic data distribution model, classification rules, feature selection routines and error estimation methods. The code for multiple-rule analysis is implemented in MATLAB. The source code is available at http://gsp.tamu.edu/Publications/supplementary/yousefi11a/. Supplementary simulation results are also included.

MOTIVATION: The receiver operator characteristic (ROC) curves are commonly used in biomedical applications to judge the performance of a discriminant across varying decision thresholds. The estimated ROC curve depends on the true positive rate (TPR) and false positive rate (FPR), with the key metric being the area under the curve (AUC). With small samples these rates need to be estimated from the training data, so a natural question arises: How well do the estimates of the AUC, TPR and FPR compare with the true metrics? RESULTS: Through a simulation study using data models and analysis of real microarray data, we show that (i) for small samples the root mean square differences of the estimated and true metrics are considerable; (ii) even for large samples, there is only weak correlation between the true and estimated metrics; and (iii) generally, there is weak regression of the true metric on the estimated metric. For classification rules, we consider linear discriminant analysis, linear support vector machine (SVM) and radial basis function SVM. For error estimation, we consider resubstitution, three kinds of cross-validation and bootstrap. Using resampling, we show the unreliability of some published ROC results. AVAILABILITY: Companion web site at http://compbio.tgen.org/paper_supp/ROC/roc.html CONTACT: [email protected].

MOTIVATION: It is commonplace for authors to propose a new classification rule, either the operator construction part or feature selection, and demonstrate its performance on real data sets, which often come from high-dimensional studies, such as from gene-expression microarrays, with small samples. Owing to the variability in feature selection and error estimation, individual reported performances are highly imprecise. Hence, if only the best test results are reported, then these will be biased relative to the overall performance of the proposed procedure. RESULTS: This article characterizes reporting bias with several statistics and computes these statistics in a large simulation study using both modeled and real data. The results appear as curves giving the different reporting biases as functions of the number of samples tested when reporting only the best or second best performance. It does this for two classification rules, linear discriminant analysis (LDA) and 3-nearest-neighbor (3NN), and for filter and wrapper feature selection, t-test and sequential forward search. These were chosen on account of their well-studied properties and because they were amenable to the extremely large amount of processing required for the simulations. The results across all the experiments are consistent: there is generally large bias overriding what would be considered a significant performance differential, when reporting the best or second best performing data set. We conclude that there needs to be a database of data sets and that, for those studies depending on real data, results should be reported for all data sets in the database. AVAILABILITY: Companion web site at http://gsp.tamu.edu/Publications/supplementary/yousefi09a/

MOTIVATION: The technology to genotype single nucleotide polymorphisms (SNPs) at extremely high densities provides for hypothesis-free genome-wide scans for common polymorphisms associated with complex disease. However, we find that some errors introduced by commonly employed genotyping algorithms may lead to inflation of false associations between markers and phenotype. RESULTS: We have developed a novel SNP genotype calling program, SNiPer-High Density (SNiPer-HD), for highly accurate genotype calling across hundreds of thousands of SNPs. The program employs an expectation-maximization (EM) algorithm with parameters based on a training sample set. The algorithm choice allows for highly accurate genotyping for most SNPs. Also, we introduce a quality control metric for each assayed SNP, such that poor-behaving SNPs can be filtered using a metric correlating to genotype class separation in the calling algorithm. SNiPer-HD is superior to the standard dynamic modeling algorithm and is complementary and non-redundant to other algorithms, such as BRLMM. Implementing multiple algorithms together may provide highly accurate genotyping calls, without inflation of false positives due to systematically miss-called SNPs. A reliable and accurate set of SNP genotypes for increasingly dense panels will eliminate some false association signals and false negative signals, allowing for rapid identification of disease susceptibility loci for complex traits. AVAILABILITY: SNiPer-HD is available at TGen's website: http://www.tgen.org/neurogenomics/data.

MOTIVATION: Given a large set of potential features, such as the set of all gene-expression values from a microarray, it is necessary to find a small subset with which to classify. The task of finding an optimal feature set of a given size is inherently combinatoric because to assure optimality all feature sets of a given size must be checked. Thus, numerous suboptimal feature-selection algorithms have been proposed. There are strong impediments to evaluate feature-selection algorithms using real data when data are limited, a common situation in genetic classification. The difficulty is compound. First, there are no class-conditional distributions from which to draw data points, only a single small labeled sample. Second, there are no test data with which to estimate the feature-set errors, and one must depend on a training-data-based error estimator. Finally, there is no optimal feature set with which to compare the feature sets found by the algorithms. RESULTS: This paper describes a genetic test bed for the evaluation of feature-selection algorithms. It begins with a large biological feature-label dataset that is used as an empirical distribution and, using massively parallel computation, finds the top feature sets of various sizes based on a given sample size and classification rule. The user can draw random samples from the data, apply a proposed algorithm, and evaluate the proficiency of the proposed algorithm via three different measures (code provided). A key feature of the test bed is that, once a dataset is input, a single command creates the entire test bed relative to the dataset. The particular dataset used for the first version of the test bed comes from a microarray-based classification study that analyzes a large number of microarrays, prepared with RNA from breast tumor samples from each of 295 patients. AVAILABILITY: The software and supplementary material are available at http://public.tgen.org/tgen-cb/support/testbed/ CONTACT: [email protected].

BACKGROUND: Overfitting the data is a salient issue for classifier design in small-sample settings. This is why selecting a classifier from a constrained family of classifiers, ones that do not possess the potential to too finely partition the feature space, is typically preferable. But overfitting is not merely a consequence of the classifier family; it is highly dependent on the classification rule used to design a classifier from the sample data. Thus, it is possible to consider families that are rather complex but for which there are classification rules that perform well for small samples. Such classification rules can be advantageous because they facilitate satisfactory classification when the class-conditional distributions are not easily separated and the sample is not large. Here we consider neural networks, from the perspectives of classical design based solely on the sample data and from noise-injection-based design. RESULTS: This paper provides an extensive simulation-based comparative study of noise-injected neural-network design. It considers a number of different feature-label models across various small sample sizes using varying amounts of noise injection. Besides comparing noise-injected neural-network design to classical neural-network design, the paper compares it to a number of other classification rules. Our particular interest is with the use of microarray data for expression-based classification for diagnosis and prognosis. To that end, we consider noise-injected neural-network design as it relates to a study of survivability of breast cancer patients. CONCLUSION: The conclusion is that in many instances noise-injected neural network design is superior to the other tested methods, and in almost all cases it does not perform substantially worse than the best of the other methods. Since the amount of noise injected is consequential, the effect of differing amounts of injected noise must be considered.

Progressive video delivery over wireless networks is very challenging due to the time-varying nature of wireless channels and limited power in the mobile devices. This paper proposes an end-to-end architecture for multilayer progressive video delivery over space-time differentially coded orthogonal frequency division multiplexing (STDC-OFDM) systems. An input video sequence is compressed by 3D-ESCOT into a layered bitstream. We input multiple layers of the bitstream in series to a STDC-OFDM channel. Different video source layers are protected by different error protection schemes in order to achieve unequal error protection. In progressive transmission, the reconstruction quality is important not only at the target transmission rate but also at the intermediate rates. So, the error protection strategy needs to optimize the average performance over the set of intermediate rates. We propose to use progressive joint source-channel coding to generate operational transmission distortion-rate (TD-R) functions and operational transmission distortion-power (TD-P) functions for multiple layers before forming the operational transmission distortion-power-rate (TD-PR) surfaces. Lagrange multipliers are then employed on the fly to obtain the optimal power allocation and optimal rate allocation among multiple layers, subject to constraints on the total transmission rate and the total power level. Progressive joint source-channel coding offers the scalability feature to handle bandwidth variations and changes in channel conditions. By extending the rate-distortion function in source coding to the TD-PR surface in joint source-channel coding, our work can use the "equal slope" argument to effectively solve the transmission rate allocation problem as well as the transmission power allocation problem for multilayer video transmission. Experiments show that our scheme achieves significant improvement over a nonoptimal system with the same total power level and total transmission rate.

MOTIVATION: Given the joint feature-label distribution, increasing the number of features always results in decreased classification error; however, this is not the case when a classifier is designed via a classification rule from sample data. Typically (but not always), for fixed sample size, the error of a designed classifier decreases and then increases as the number of features grows. The potential downside of using too many features is most critical for small samples, which are commonplace for gene-expression-based classifiers for phenotype discrimination. For fixed sample size and feature-label distribution, the issue is to find an optimal number of features. RESULTS: Since only in rare cases is there a known distribution of the error as a function of the number of features and sample size, this study employs simulation for various feature-label distributions and classification rules, and across a wide range of sample and feature-set sizes. To achieve the desired end, finding the optimal number of features as a function of sample size, it employs massively parallel computation. Seven classifiers are treated: 3-nearest-neighbor, Gaussian kernel, linear support vector machine, polynomial support vector machine, perceptron, regular histogram and linear discriminant analysis. Three Gaussian-based models are considered: linear, nonlinear and bimodal. In addition, real patient data from a large breast-cancer study is considered. To mitigate the combinatorial search for finding optimal feature sets, and to model the situation in which subsets of genes are co-regulated and correlation is internal to these subsets, we assume that the covariance matrix of the features is blocked, with each block corresponding to a group of correlated features. Altogether there are a large number of error surfaces for the many cases. These are provided in full on a companion website, which is meant to serve as resource for those working with small-sample classification. AVAILABILITY: For the companion website, please visit http://public.tgen.org/tamu/ofs/ CONTACT: [email protected].

This paper presents Microarray BASICA: an integrated image processing tool for background adjustment, segmentation, image compression and analysis of microarray images. BASICA uses the fast Mann-Whitney test-based algorithm introduced in J. Hua et al., (2002) to segment microarray images, and post-processing to eliminate the segmentation irregularities. The segmentation results, along with the foreground and background intensities obtained with background adjustment, are then used for the independent compression of foreground and background. We introduce a new distortion measure for microarray image compression and devise a coding scheme by modifying the object-based embedded block coding with optimized truncation (object-based EBCOT) algorithm J. Hua et al., (2002) to achieve optimal rate-distortion performance in lossy coding while still maintaining outstanding lossless compression performance. Experimental results show that BASICA can extract sufficiently accurate genetic information at bitrates as low as 43bpp.

This paper presents an optimal rate allocation scheme in joint source-channel coding (JSCC) for image transmission over CDMA networks. Our scheme first uses progressive joint source-channel codes [V. Stankovic et al., Sep. 2002] to generate operational transmission rate-distortion (TR-D) functions of different multiple-access channels with different BERs. The Lagrange multiplier is then employed to set the optimal rate allocation among different channels, subject to a total transmission rate constraint. Progressive JSCC offers the scalability feature that is very attractive for handling bandwidth variations in wireless communications. By extending the rate-distortion function in source coding to the TR-D function in JSCC, our work borrows the "equal slope" argument [Y. Shoham and A. Gersho, Sep. 1988] to effectively solve the rate allocation problem in JSCC for multi-channel image transmission. Experiments show that our scheme runs in real time and provides competitive performance at all intermediate transmission rates.

We study lossy-to-lossless compression of medical volumetric data using three-dimensional (3-D) integer wavelet transforms. To achieve good lossy coding performance, it is important to have transforms that are unitary. In addition to the lifting approach, we first introduce a general 3-D integer wavelet packet transform structure that allows implicit bit shifting of wavelet coefficients to approximate a 3-D unitary transformation. We then focus on context modeling for efficient arithmetic coding of wavelet coefficients. Two state-of-the-art 3-D wavelet video coding techniques, namely, 3-D set partitioning in hierarchical trees (Kim et al., 2000) and 3-D embedded subband coding with optimal truncation (Xu et al., 2001), are modified and applied to compression of medical volumetric data, achieving the best performance published so far in the literature-both in terms of lossy and lossless compression.

This paper proposes an integrated approach to receiver-driven layered multicast (RLM) based on packetized wavelet video (PWV) coding and error control. The PWV coder produces packetized layered bitstreams that are independent among layers while being embedded within each layer. Error control determines the optimal joint source-channel coding trade-off given the available transmission rate to mitigate the effects of packet loss. The PWV coder is designed to facilitate its integration with error control for RLM such that packets from different source layers are generated in a rate-distortion optimized way and a lost packet only renders the following packets in the same layer useless. Our work extends the single-layered approach in Chou et al., (2001). Theoretical analysis shows a gain of up to 1 dB on a channel with 20% packet loss over results presented in Chou. This gain is also substantiated by our simulations with a gain of up to 2.2 dB.

This paper presents a rate-distortion (R-D) optimized 3-D embedded wavelet video (EWV) coder by extending the concept of EBCOT from 2-D to 3-D. After a lifting based 3-D wavelet transform, different subbands are coded independently using bit plane coding with different context models to provide flexible scalability in both spatial and temporal domain. A global R-D optimization procedure is used to generate an embedded bitstream for a target bit rate. Experiments show that, even without motion estimation, the EWV coder outperforms both MPEG-4 and 3-D ESCOT for most low motion video sequences.