Michael S. Waterman

dblp:w/MichaelSWaterman · DBLP profile ↗
← Back
34ranked-venue papers
3as first author
1since 2021 · last 2021
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Applied, interdisciplinary, general and emerging computing · 25 · 2 first-authorTheory of computation · 5 · 1 first-author · 1 since 2021Systems, architecture and hardware · 2Graphics, computer vision, multimedia, augmented reality and games · 2
YearPublicationVenuePosition
2021 Levenshtein Distance, Sequence Comparison and Biological Database Search
abstract
Levenshtein edit distance has played a central role-both past and present-in sequence alignment in particular and biological database similarity search in general. We start our review with a history of dynamic programming algorithms for computing Levenshtein distance and sequence alignments. Following, we describe how those algorithms led to heuristics employed in the most widely used software in bioinformatics, BLAST, a program to search DNA and protein databases for evolutionarily relevant similarities. More recently, the advent of modern genomic sequencing and the volume of data it generates has resulted in a return to the problem of local alignment. We conclude with how the mathematical formulation of Levenshtein distance as a metric made possible additional optimizations to similarity search in biological contexts. These modern optimizations are built around the low metric entropy and fractional dimensionality of biological databases, enabling orders of magnitude acceleration of biological similarity search.
Bonnie Berger, Michael S. Waterman, Yun William Yu
IEEE Trans. Inf. Theory2
2019 A new statistic for efficient detection of repetitive sequences
abstract
MOTIVATION: Detecting sequences containing repetitive regions is a basic bioinformatics task with many applications. Several methods have been developed for various types of repeat detection tasks. An efficient generic method for detecting most types of repetitive sequences is still desirable. Inspired by the excellent properties and successful applications of the D2 family of statistics in comparative analyses of genomic sequences, we developed a new statistic D2R that can efficiently discriminate sequences with or without repetitive regions. RESULTS: Using the statistic, we developed an algorithm of linear time and space complexity for detecting most types of repetitive sequences in multiple scenarios, including finding candidate clustered regularly interspaced short palindromic repeats regions from bacterial genomic or metagenomics sequences. Simulation and real data experiments show that the method works well on both assembled sequences and unassembled short reads. AVAILABILITY AND IMPLEMENTATION: The codes are available at https://github.com/XuegongLab/D2R_codes under GPL 3.0 license. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
Fengzhu Sun, Michael S. Waterman, Xuegong Zhang
Bioinform.4
2018 Generalized correlation measure using count statistics for gene expression data with ordered samples
abstract
Motivation: Capturing association patterns in gene expression levels under different conditions or time points is important for inferring gene regulatory interactions. In practice, temporal changes in gene expression may result in complex association patterns that require more sophisticated detection methods than simple correlation measures. For instance, the effect of regulation may lead to time-lagged associations and interactions local to a subset of samples. Furthermore, expression profiles of interest may not be aligned or directly comparable (e.g. gene expression profiles from two species). Results: We propose a count statistic for measuring association between pairs of gene expression profiles consisting of ordered samples (e.g. time-course), where correlation may only exist locally in subsequences separated by a position shift. The statistic is simple and fast to compute, and we illustrate its use in two applications. In a cross-species comparison of developmental gene expression levels, we show our method not only measures association of gene expressions between the two species, but also provides alignment between different developmental stages. In the second application, we applied our statistic to expression profiles from two distinct phenotypic conditions, where the samples in each profile are ordered by the associated phenotypic values. The detected associations can be useful in building correspondence between gene association networks under different phenotypes. On the theoretical side, we provide asymptotic distributions of the statistic for different regions of the parameter space and test its power on simulated data. Availability and implementation: The code used to perform the analysis is available as part of the Supplementary Material. Contact: [email protected] or [email protected]. Supplementary information: Supplementary data are available at Bioinformatics online.
Y. X. Rachel Wang, Elizabeth Theusch, Jerome I. Rotter, Marisa W. Medina, Michael S. Waterman
Bioinform.6
2014 New developments of alignment-free sequence comparison: measures, statistics and next-generation sequencing
abstract
With the development of next-generation sequencing (NGS) technologies, a large amount of short read data has been generated. Assembly of these short reads can be challenging for genomes and metagenomes without template sequences, making alignment-based genome sequence comparison difficult. In addition, sequence reads from NGS can come from different regions of various genomes and they may not be alignable. Sequence signature-based methods for genome comparison based on the frequencies of word patterns in genomes and metagenomes can potentially be useful for the analysis of short reads data from NGS. Here we review the recent development of alignment-free genome and metagenome comparison based on the frequencies of word patterns with emphasis on the dissimilarity measures between sequences, the statistical power of these measures when two sequences are related and the applications of these measures to NGS data.
Jie Ren 0006, Gesine Reinert, Minghua Deng, Michael S. Waterman, Fengzhu Sun
Briefings Bioinform.5
2011 Integrative Analysis of Many Weighted Co-Expression Networks Using Tensor Computation
abstract
The rapid accumulation of biological networks poses new challenges and calls for powerful integrative analysis tools. Most existing methods capable of simultaneously analyzing a large number of networks were primarily designed for unweighted networks, and cannot easily be extended to weighted networks. However, it is known that transforming weighted into unweighted networks by dichotomizing the edges of weighted networks with a threshold generally leads to information loss. We have developed a novel, tensor-based computational framework for mining recurrent heavy subgraphs in a large set of massive weighted networks. Specifically, we formulate the recurrent heavy subgraph identification problem as a heavy 3D subtensor discovery problem with sparse constraints. We describe an effective approach to solving this problem by designing a multi-stage, convex relaxation protocol, and a non-uniform edge sampling technique. We applied our method to 130 co-expression networks, and identified 11,394 recurrent heavy subgraphs, grouped into 2,810 families. We demonstrated that the identified subgraphs represent meaningful biological modules by validating against a large set of compiled biological knowledge bases. We also showed that the likelihood for a heavy subgraph to be meaningful increases significantly with its recurrence in multiple networks, highlighting the importance of the integrative approach to biological network analysis. Moreover, our approach based on weighted graphs detects many patterns that would be overlooked using unweighted graphs. In addition, we identified a large number of modules that occur predominately under specific phenotypes. This analysis resulted in a genome-wide mapping of gene network modules onto the phenome. Finally, by comparing module activities across many datasets, we discovered high-order dynamic cooperativeness in protein complex networks and transcriptional regulatory networks.
Wenyuan Li 0006, Chun-Chi Liu, Tong Zhang 0001, Michael S. Waterman, Xianghong Jasmine Zhou
PLoS Comput. Biol.5
2010 An integrative modular approach to systematically predict gene-phenotype associations
abstract
BACKGROUND: Complex human diseases are often caused by multiple mutations, each of which contributes only a minor effect to the disease phenotype. To study the basis for these complex phenotypes, we developed a network-based approach to identify coexpression modules specifically activated in particular phenotypes. We integrated these modules, protein-protein interaction data, Gene Ontology annotations, and our database of gene-phenotype associations derived from literature to predict novel human gene-phenotype associations. Our systematic predictions provide us with the opportunity to perform a global analysis of human gene pleiotropy and its underlying regulatory mechanisms. RESULTS: We applied this method to 338 microarray datasets, covering 178 phenotype classes, and identified 193,145 phenotype-specific coexpression modules. We trained random forest classifiers for each phenotype and predicted a total of 6,558 gene-phenotype associations. We showed that 40.9% genes are pleiotropic, highlighting that pleiotropy is more prevalent than previously expected. We collected 77 ChIP-chip datasets studying 69 transcription factors binding over 16,000 targets under various phenotypic conditions. Utilizing this unique data source, we confirmed that dynamic transcriptional regulation is an important force driving the formation of phenotype specific gene modules. CONCLUSION: We created a genome-wide gene to phenotype mapping that has many potential implications, including providing potential new drug targets and uncovering the basis for human disease phenotypes. Our analysis of these phenotype-specific coexpression modules reveals a high prevalence of gene pleiotropy, and suggests that phenotype-specific transcription factor binding may contribute to phenotypic diversity. All resources from our study are made freely available on our online Phenotype Prediction Database.
Michael R. Mehan, Juan Nunez-Iglesias, Chao Dai, Michael S. Waterman, Xianghong Jasmine Zhou
BMC Bioinform.4
2009 HAPLOWSER: a whole-genome haplotype browser for personal genome and metagenome
abstract
SUMMARY: Haplotype assembly is becoming a very important tool in genome sequencing of human and other organisms. Although haplotypes were previously inferred from genome assemblies, there has never been a comparative haplotype browser that depicts a global picture of whole-genome alignments among haplotypes of different organisms. We introduce a whole-genome HAPLotype brOWSER (HAPLOWSER), providing evolutionary perspectives from multiple aligned haplotypes and functional annotations. Haplowser enables the comparison of haplotypes from metagenomes, and associates conserved regions or the bases at the conserved regions with functional annotations and custom tracks. The associations are quantified for further analysis and presented as pie charts. Functional annotations and custom tracks that are projected onto haplotypes are saved as multiple files in FASTA format. Haplowser provides a user-friendly interface, and can display alignments of haplotypes with functional annotations at any resolution. AVAILABILITY: Haplowser, written in Java, supports multiple platforms including Windows and Linux. Haplowser is publicly available at http://embio.yonsei.ac.kr/haplowser .
Woo-Cheol Kim, Michael S. Waterman, Sanghyun Park 0003, Lei M. Li
Bioinform.3
2009 The Seventh Asia Pacific Bioinformatics Conference (APBC2009)
abstract
The Asia Pacific Bioinformatics Conference (APBC) series, founded in 2003, is an annual international forum for exploring research, development and applications of Bioinformatics and Computational Biology.The Seventh Asia Pacific Bioinformatics Conference (APBC2009) was held at Tsinghua University,
Michael Q. Zhang, Michael S. Waterman, Xuegong Zhang
BMC Bioinform.2
2009 New Generations: Sequencing Machines and Their Computational Challenges
David C. Schwartz, Michael S. Waterman
J. Comput. Sci. Technol.2
2008 An Integrative Network Approach to Map the Transcriptome to the Phenome
Michael R. Mehan, Juan Nunez-Iglesias, Mrinal Kalakrishnan, Michael S. Waterman, Xianghong Jasmine Zhou
RECOMB4
2007 Accuracy Assessment of Diploid Consensus Sequences
abstract
If the origins of fragments are known in genome sequencing projects, it is straightforward to reconstruct diploid consensus sequences. In reality, however, this is not true. Although there are proposed methods to reconstruct haplotypes from genome sequencing projects, an accuracy assessment is required to evaluate the confidence of the estimated diploid consensus sequences. In this paper, we define the confidence score of diploid consensus sequences. It requires the calculation of the likelihood of an assembly. To calculate the likelihood, we propose a linear time algorithm with respect to the number of polymorphic sites. The likelihood calculation and confidence score are used for further improvements of haplotype estimation in two directions. One direction is that low-scored phases are disconnected. The other direction is that, instead of using nominal frequency 1/2, the haplotype frequency is estimated to reflect the actual contribution of each haplotype. Our method was evaluated on the simulated data whose polymorphism rate (1.2 percent) was based on Ciona intestinalis. As a result, the high accuracy of our algorithm was indicated: The true positive rate of the haplotype estimation was greater than 97 percent.
Michael S. Waterman, Lei M. Li
IEEE ACM Trans. Comput. Biol. Bioinform.2
2007 On the Length of the Longest Exact Position Match in a Random Sequence
abstract
A mixed Poisson approximation and a Poisson approximation for the length of the longest exact match of a random sequence across another sequence are provided, where the match is required to start at position 1 in the first sequence. This problem arises when looking for suitable anchors in whole genome alignments.
Gesine Reinert, Michael S. Waterman
IEEE ACM Trans. Comput. Biol. Bioinform.2
2006 Whole Genome Optical Mapping
Michael S. Waterman
APBC1
2006 Stan Ulam and Computational Biology
Michael S. Waterman
RECOMB1
2006 Refinement of optical map assemblies
abstract
MOTIVATION: Genomic mutations and variations provide insightful information about the functionality of sequence elements and their association with human diseases. Traditionally, variations are identified through analysis of short DNA sequences, usually shorter than 1000 bp per fragment. Optical maps provide both faster and more cost-efficient means for detecting such differences, because a single map can span over 1 million bp. Optical maps are assembled to cover the whole genome, and the accuracy of assembly is critical. RESULTS: We present a computationally efficient model-based method for improving quality of such assemblies. Our method provides very high accuracy even with moderate coverage (<20 x). We utilize a hidden Markov model to represent the consensus map and use the expectation-Maximization algorithm to drive the refinement process. We also provide quality scores to assess the quality of the finished map. AVAILABILITY: Code is available from www.cmb.usc.edu/people/valouev/
Anton Valouev, Yu Zhang 0002, David C. Schwartz, Michael S. Waterman
Bioinform.4
2006 Integrative missing value estimation for microarray data
abstract
BACKGROUND: Missing value estimation is an important preprocessing step in microarray analysis. Although several methods have been developed to solve this problem, their performance is unsatisfactory for datasets with high rates of missing data, high measurement noise, or limited numbers of samples. In fact, more than 80% of the time-series datasets in Stanford Microarray Database contain less than eight samples. RESULTS: We present the integrative Missing Value Estimation method (iMISS) by incorporating information from multiple reference microarray datasets to improve missing value estimation. For each gene with missing data, we derive a consistent neighbor-gene list by taking reference data sets into consideration. To determine whether the given reference data sets are sufficiently informative for integration, we use a submatrix imputation approach. Our experiments showed that iMISS can significantly and consistently improve the accuracy of the state-of-the-art Local Least Square (LLS) imputation algorithm by up to 15% improvement in our benchmark tests. CONCLUSION: We demonstrated that the order-statistics-based integrative imputation algorithms can achieve significant improvements over the state-of-the-art missing value estimation approaches such as LLS and is especially good for imputing microarray datasets with a limited number of samples, high rates of missing data, or very noisy measurements. With the rapid accumulation of microarray datasets, the performance of our approach can be further improved by incorporating larger and more appropriate reference datasets.
Jianjun Hu, Michael S. Waterman, Xianghong Jasmine Zhou
BMC Bioinform.3
2005 Alignment of Optical Maps
Anton Valouev, Yu-Chi Liu, David C. Schwartz, Yi Yang 0047, Yu Zhang 0002, Michael S. Waterman
RECOMB7
2005 HapBlock: haplotype block partitioning and tag SNP selection software using a set of dynamic programming algorithms
abstract
UNLABELLED: Recent studies have revealed that linkage disequilibrium (LD) patterns vary across the human genome with some regions of high LD interspersed with regions of low LD. Such LD patterns make it possible to select a set of single nucleotide polymorphism (SNPs; tag SNPs) for genome-wide association studies. We have developed a suite of computer programs to analyze the block-like LD patterns and to select the corresponding tag SNPs. Compared to other programs for haplotype block partitioning and tag SNP selection, our program has several notable features. First, the dynamic programming algorithms implemented are guaranteed to find the block partition with minimum number of tag SNPs for the given criteria of blocks and tag SNPs. Second, both haplotype data and genotype data from unrelated individuals and/or from general pedigrees can be analyzed. Third, several existing measures/criteria for haplotype block partitioning and tag SNP selection have been implemented in the program. Finally, the programs provide flexibility to include specific SNPs (e.g. non-synonymous SNPs) as tag SNPs. AVAILABILITY: The HapBlock program and its supplemental documents can be downloaded from the website http://www.cmb.usc.edu/~msms/HapBlock.
Zhaohui S. Qin, Ting Chen 0006, Jun S. Liu, Michael S. Waterman, Fengzhu Sun
Bioinform.5
2003 Haplotype reconstruction from SNP alignment
abstract
In this paper, we describe a method for statistical reconstruction of haplotypes from a set of aligned SNP fragments. We consider the case of a pair of homologous human chromosomes, one from the mother and the other from the father. After fragment assembly, we wish to reconstruct the two haplotypes of the parents. Given a set of potential SNP sites inferred from the assembly alignment, we wish to divide the fragment set into two subsets, each of which represents one chromosome. Our method is based on a statistical model of sequencing errors, compositional information, and haplotype memberships. We calculate probabilities of different haplotypes conditional on the alignment. Due to computational complexity, we first determine phases for neighboring SNPs. Then we connect them and construct haplotype segments. Also, we compute the accuracy or confidence of the reconstructed haplotypes. We discuss other issues, such as alternative methods, parameter estimation, computational efficiency, and relaxation of assumptions.
Lei M. Li, Michael S. Waterman
RECOMB3
2003 Dynamic programming algorithms for haplotype block partitioning: applications to human chromosome 21 haplotype data
abstract
Recent studies have shown that the human genome has a haplotype block structure such that it can be divided into discrete blocks of limited haplotype diversity. Patil et al. [6] and Zhang et al. [12] developed algorithms to partition haplotypes into blocks with minimum number of tag SNPs for the entire chromosome. However, it is not clear how to partition haplotypes into blocks with restricted number of SNPs when only limited resources are available. In this paper, we first formulated this problem as finding a block partition with a fixed number of tag SNPs that can cover the maximal percentage of a genome. Then we solved it by two dynamic programming algorithms, which are fairly flexible to take into account the knowledge of functional polymorphism. We applied our algorithms to the published SNP data of human chromosome 21 combining with the functional information of these SNPs and demonstrated the effectiveness of them. Statistical investigation of the relationship between the starting points of a block partition and the coding and non-coding regions illuminated that the SNPs at these starting points are not significantly enriched in coding regions. We also developed an efficient algorithm to find all possible long local maximal haplotypes across a subset of samples. After applying this algorithm to the human chromosome 21 haplotype data, we found that samples with long local haplotypes are not necessarily globally similar.
Fengzhu Sun, Michael S. Waterman, Ting Chen 0006
RECOMB3
2001 A new approach to fragment assembly in DNA sequencing
abstract
For the last twenty years fragment assembly in DNA sequencing followed the “overlap - layout - consensus” paradigm that is used in all currently available assembly tools. Although this approach proved to be useful in assembling clones, it faces difficulties in genomic shotgun assembly: the existing algorithms make assembly errors and are often unable to resolve repeats even in prokaryotic genomes. Biologists are well-aware of these errors and are forced to carry additional experiments to verify the assembled contigs.
Pavel A. Pevzner, Haixu Tang, Michael S. Waterman
RECOMB3
2001 Zinc finger gene clusters and tandem gene duplication
abstract
Zinc finger genes in mammalian genomes are frequently found to occur in clusters with cluster members appearing in a tandem array on the chromosome. It has been suggested that in situ gene duplication events are primarily responsible for the evolution of such clusters. The problem of inferring the series of duplication events responsible for producing clustered families is different from the standard phylogeny problem. In this paper we study this inference problem using a graph called Duplication Model that captures the series of duplication events while taking into account the observed order of the genes on the chromosome. We provide algorithms to reconstruct a duplication model for a given data set. We use our method to hypothesise the series of duplication events that may have produced the ZNF45 family that appears on human chromosome 19.
Mengxiang Tang, Michael S. Waterman, Shibu Yooseph
RECOMB2
1998 Estimation for restriction sites observed by optical mapping using reversible-jump Markov chain Monte Carlo
abstract
moIec&r-biology technology in constructing restriction maps, Optical Mapping, has been developed by Schwartz et al.
Jae Kyu Lee, Vlado Dancík, Michael S. Waterman
RECOMB3
1997 Chimeric alignment by dynamic programming: algorithm and biological uses
abstract
A new nearest-neighbor method for detecting chimeric 16s rRNA artifacts generated during PCR amplification from mixed populations has been developed.The method uses dynamic programming to generate an optimal chimeric alignment, defined as the highest scoring alignment between a query and a concatenation of a 5' and a 3' segment from two separate entries from a database of related sequences.Chimeras are detected by studying the scores and form of the chimeric and global sequence alignments.The chimeric alignment method was found to be marginally more effective than btuple based nearest-neighbor methods in simulation studies, but its most effective use is in concert with k-tuple methods.
George A. Komatsoulis, Michael S. Waterman
RECOMB2
1997 Pooling strategies for establishing physical genome maps using FISH
abstract
Often, in biological studies, it is necessary to identify an organism’s chromosomes. In some organisms the individual chromosomes can be identified by staining procedures while many other species have a very large number of chromosomes, often of similar size, which defy identification by traditional staining methods. We have devised strategies, based on fluores-cent in situ hybridization (FISH), which allow the assignment of a preset number of probes to each chromosome without prior chromosome identification. By hybridizing mixtures of probes labeled with different colored fluorescent molecules, the chromosomal origin of each probe can be determined. Key words: FISH, chromosome characterization, experimental design, coupon collector problem, mathematical modeling 1.
Fengzhu Sun, Gary Benson, Norman Arnheim, Michael S. Waterman
RECOMB4
1996 Alignment Networks and Electrical Networks
Martin Vingron, Michael S. Waterman
Discret. Appl. Math.2
1995 Multiple Filtration and Approximate Pattern Matching
Pavel A. Pevzner, Michael S. Waterman
Algorithmica2
1994 Linear Trees and RNA Secondary Structure
William R. Schmitt, Michael S. Waterman
Discret. Appl. Math.2
1993 A Fast Filtration Algorithm for the Substring Matching Problem
Pavel A. Pevzner, Michael S. Waterman
CPM2
1993 Sequence Comparison and Statistical Significance in Molecular Biology (Abstract)
Michael S. Waterman
ESA1
1992 Matrix Longest Common Subsequence Problem, Duality and Hibert Bases
Pavel A. Pevzner, Michael S. Waterman
CPM2
1992 Dynamic programming algorithms for restriction map comparison
abstract
For most sequence comparison problems there is a corresponding map comparison algorithm. While map data may appear to be incompatible with dynamic programming, we show in this paper that the rigor and efficiency of dynamic programming algorithms carry over to the map comparison algorithms. We present algorithms for restriction map comparison that deal with two types of map errors: (i) closely spaced sites for different enzymes can be ordered incorrectly, and (ii) closely spaced sites for the same enzyme can be mapped as a single site. The new algorithms are a natural extension of a previous map comparison model. Dynamic programming algorithms for computing optimal global and local alignments under the new model are described. The new algorithms take about the same order of time as previous map comparison algorithms. Programs implementing some of the new algorithms are used to find similar regions within the Escherichia coli restriction map of Kohara et al.
Michael S. Waterman
Comput. Appl. Biosci.2
1991 Biological information signal processor
abstract
The computation requirements for mapping and sequencing the human genome might soon exceed the capability of any existing supercomputer. The systolic array processor presented in this paper, called biological information signal processor (BISP), has the capability to satisfy the current and anticipated future computational requirements for performing sequence comparisons based on the T.F. Smith and M.S. Waterman algorithm (1981) as extended by M.S. Waterman and M. Eggert (1987). The BISP can conduct the most time consuming sequence comparison functions, establishing both global and local relationships between two sequences. A modified Smith and Waterman algorithm is presented in this paper for efficient VLSI implementation. Methods are developed to reduce the BISP systolic array I/O bandwidth problem by reporting only the statistical significant results. Estimated performance of the BISP is compared with several different computer architectures.>
E. T. Chow, Tim Hunkapiller, J. Peterson, Michael S. Waterman
ASAP4
1991 A systolic array processor for biological information signal processing
abstract
The Biological Information Signal Processing (BISP) is a system for high speed sequence comparisons designed to support the computation requirements for mapping and sequencing the human and other genomes. The heart of a BISP system is a versatile processor chip that can conduct the most time consuming sequence comparison functions, establishing both global and local relationships between two DNA or protein sequences. Because of \nthe application’s strong computation and communication \nrequirements, a programmable systolic array architecture was \ndeveloped. A BISP system can include a large number of \nprocessing elements; the initial BISP demonstration system \nconsists of 768 BISP elements, capable of delivering more than 6.25 x 10^9 integer operations per second. The system can be expanded to include over 4,000 elements, This paper describes the comparison algorithm and outlines the BISP chip and system designs. Estimated performance of the BISP system is compared with several different computer architectures.
E. T. Chow, John C. Peterson, Michael S. Waterman, Tim Hunkapiller, Barbara A. Zimmermann
ICS3