VLDB 2026 Research / reviewers in the wild / expert
Michael S. Waterman
dblp:w/MichaelSWaterman
· DBLP profile ↗
34ranked-venue papers
3as first author
1since 2021 · last 2021
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Applied, interdisciplinary, general and emerging computing · 25 · 2 first-authorTheory of computation · 5 · 1 first-author · 1 since 2021Systems, architecture and hardware · 2Graphics, computer vision, multimedia, augmented reality and games · 2
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2021 | Levenshtein Distance, Sequence Comparison and Biological Database SearchabstractLevenshtein edit distance has played a central role-both past and present-in sequence alignment in particular and biological database similarity search in general. We start our review with a history of dynamic programming algorithms for computing Levenshtein distance and sequence alignments. Following, we describe how those algorithms led to heuristics employed in the most widely used software in bioinformatics, BLAST, a program to search DNA and protein databases for evolutionarily relevant similarities. More recently, the advent of modern genomic sequencing and the volume of data it generates has resulted in a return to the problem of local alignment. We conclude with how the mathematical formulation of Levenshtein distance as a metric made possible additional optimizations to similarity search in biological contexts. These modern optimizations are built around the low metric entropy and fractional dimensionality of biological databases, enabling orders of magnitude acceleration of biological similarity search. Bonnie Berger, Michael S. Waterman, Yun William Yu |
IEEE Trans. Inf. Theory | 2 |
| 2019 | A new statistic for efficient detection of repetitive sequencesabstractMOTIVATION: Detecting sequences containing repetitive regions is a basic bioinformatics task with many applications. Several methods have been developed for various types of repeat detection tasks. An efficient generic method for detecting most types of repetitive sequences is still desirable. Inspired by the excellent properties and successful applications of the D2 family of statistics in comparative analyses of genomic sequences, we developed a new statistic D2R that can efficiently discriminate sequences with or without repetitive regions. RESULTS: Using the statistic, we developed an algorithm of linear time and space complexity for detecting most types of repetitive sequences in multiple scenarios, including finding candidate clustered regularly interspaced short palindromic repeats regions from bacterial genomic or metagenomics sequences. Simulation and real data experiments show that the method works well on both assembled sequences and unassembled short reads. AVAILABILITY AND IMPLEMENTATION: The codes are available at https://github.com/XuegongLab/D2R_codes under GPL 3.0 license. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online. Fengzhu Sun, Michael S. Waterman, Xuegong Zhang |
Bioinform. | 4 |
| 2018 | Generalized correlation measure using count statistics for gene expression data with ordered samplesabstractMotivation: Capturing association patterns in gene expression levels under different conditions or time points is important for inferring gene regulatory interactions. In practice, temporal changes in gene expression may result in complex association patterns that require more sophisticated detection methods than simple correlation measures. For instance, the effect of regulation may lead to time-lagged associations and interactions local to a subset of samples. Furthermore, expression profiles of interest may not be aligned or directly comparable (e.g. gene expression profiles from two species). Results: We propose a count statistic for measuring association between pairs of gene expression profiles consisting of ordered samples (e.g. time-course), where correlation may only exist locally in subsequences separated by a position shift. The statistic is simple and fast to compute, and we illustrate its use in two applications. In a cross-species comparison of developmental gene expression levels, we show our method not only measures association of gene expressions between the two species, but also provides alignment between different developmental stages. In the second application, we applied our statistic to expression profiles from two distinct phenotypic conditions, where the samples in each profile are ordered by the associated phenotypic values. The detected associations can be useful in building correspondence between gene association networks under different phenotypes. On the theoretical side, we provide asymptotic distributions of the statistic for different regions of the parameter space and test its power on simulated data. Availability and implementation: The code used to perform the analysis is available as part of the Supplementary Material. Contact: [email protected] or [email protected]. Supplementary information: Supplementary data are available at Bioinformatics online. Y. X. Rachel Wang, Elizabeth Theusch, Jerome I. Rotter, Marisa W. Medina, Michael S. Waterman |
Bioinform. | 6 |
| 2014 | New developments of alignment-free sequence comparison: measures, statistics and next-generation sequencingabstractWith the development of next-generation sequencing (NGS) technologies, a large amount of short read data has been generated. Assembly of these short reads can be challenging for genomes and metagenomes without template sequences, making alignment-based genome sequence comparison difficult. In addition, sequence reads from NGS can come from different regions of various genomes and they may not be alignable. Sequence signature-based methods for genome comparison based on the frequencies of word patterns in genomes and metagenomes can potentially be useful for the analysis of short reads data from NGS. Here we review the recent development of alignment-free genome and metagenome comparison based on the frequencies of word patterns with emphasis on the dissimilarity measures between sequences, the statistical power of these measures when two sequences are related and the applications of these measures to NGS data. Jie Ren 0006, Gesine Reinert, Minghua Deng, Michael S. Waterman, Fengzhu Sun |
Briefings Bioinform. | 5 |
| 2011 | Integrative Analysis of Many Weighted Co-Expression Networks Using Tensor ComputationabstractThe rapid accumulation of biological networks poses new challenges and calls for powerful integrative analysis tools. Most existing methods capable of simultaneously analyzing a large number of networks were primarily designed for unweighted networks, and cannot easily be extended to weighted networks. However, it is known that transforming weighted into unweighted networks by dichotomizing the edges of weighted networks with a threshold generally leads to information loss. We have developed a novel, tensor-based computational framework for mining recurrent heavy subgraphs in a large set of massive weighted networks. Specifically, we formulate the recurrent heavy subgraph identification problem as a heavy 3D subtensor discovery problem with sparse constraints. We describe an effective approach to solving this problem by designing a multi-stage, convex relaxation protocol, and a non-uniform edge sampling technique. We applied our method to 130 co-expression networks, and identified 11,394 recurrent heavy subgraphs, grouped into 2,810 families. We demonstrated that the identified subgraphs represent meaningful biological modules by validating against a large set of compiled biological knowledge bases. We also showed that the likelihood for a heavy subgraph to be meaningful increases significantly with its recurrence in multiple networks, highlighting the importance of the integrative approach to biological network analysis. Moreover, our approach based on weighted graphs detects many patterns that would be overlooked using unweighted graphs. In addition, we identified a large number of modules that occur predominately under specific phenotypes. This analysis resulted in a genome-wide mapping of gene network modules onto the phenome. Finally, by comparing module activities across many datasets, we discovered high-order dynamic cooperativeness in protein complex networks and transcriptional regulatory networks. Wenyuan Li 0006, Chun-Chi Liu, Tong Zhang 0001, Michael S. Waterman, Xianghong Jasmine Zhou |
PLoS Comput. Biol. | 5 |
| 2010 | An integrative modular approach to systematically predict gene-phenotype associationsabstractBACKGROUND: Complex human diseases are often caused by multiple mutations, each of which contributes only a minor effect to the disease phenotype. To study the basis for these complex phenotypes, we developed a network-based approach to identify coexpression modules specifically activated in particular phenotypes. We integrated these modules, protein-protein interaction data, Gene Ontology annotations, and our database of gene-phenotype associations derived from literature to predict novel human gene-phenotype associations. Our systematic predictions provide us with the opportunity to perform a global analysis of human gene pleiotropy and its underlying regulatory mechanisms. RESULTS: We applied this method to 338 microarray datasets, covering 178 phenotype classes, and identified 193,145 phenotype-specific coexpression modules. We trained random forest classifiers for each phenotype and predicted a total of 6,558 gene-phenotype associations. We showed that 40.9% genes are pleiotropic, highlighting that pleiotropy is more prevalent than previously expected. We collected 77 ChIP-chip datasets studying 69 transcription factors binding over 16,000 targets under various phenotypic conditions. Utilizing this unique data source, we confirmed that dynamic transcriptional regulation is an important force driving the formation of phenotype specific gene modules. CONCLUSION: We created a genome-wide gene to phenotype mapping that has many potential implications, including providing potential new drug targets and uncovering the basis for human disease phenotypes. Our analysis of these phenotype-specific coexpression modules reveals a high prevalence of gene pleiotropy, and suggests that phenotype-specific transcription factor binding may contribute to phenotypic diversity. All resources from our study are made freely available on our online Phenotype Prediction Database. Michael R. Mehan, Juan Nunez-Iglesias, Chao Dai, Michael S. Waterman, Xianghong Jasmine Zhou |
BMC Bioinform. | 4 |
| 2009 | HAPLOWSER: a whole-genome haplotype browser for personal genome and metagenomeabstractSUMMARY: Haplotype assembly is becoming a very important tool in genome sequencing of human and other organisms. Although haplotypes were previously inferred from genome assemblies, there has never been a comparative haplotype browser that depicts a global picture of whole-genome alignments among haplotypes of different organisms. We introduce a whole-genome HAPLotype brOWSER (HAPLOWSER), providing evolutionary perspectives from multiple aligned haplotypes and functional annotations. Haplowser enables the comparison of haplotypes from metagenomes, and associates conserved regions or the bases at the conserved regions with functional annotations and custom tracks. The associations are quantified for further analysis and presented as pie charts. Functional annotations and custom tracks that are projected onto haplotypes are saved as multiple files in FASTA format. Haplowser provides a user-friendly interface, and can display alignments of haplotypes with functional annotations at any resolution. AVAILABILITY: Haplowser, written in Java, supports multiple platforms including Windows and Linux. Haplowser is publicly available at http://embio.yonsei.ac.kr/haplowser . Woo-Cheol Kim, Michael S. Waterman, Sanghyun Park 0003, Lei M. Li |
Bioinform. | 3 |
| 2009 | The Seventh Asia Pacific Bioinformatics Conference (APBC2009)abstractThe Asia Pacific Bioinformatics Conference (APBC) series, founded in 2003, is an annual international forum for exploring research, development and applications of Bioinformatics and Computational Biology.The Seventh Asia Pacific Bioinformatics Conference (APBC2009) was held at Tsinghua University, Michael Q. Zhang, Michael S. Waterman, Xuegong Zhang |
BMC Bioinform. | 2 |
| 2009 | New Generations: Sequencing Machines and Their Computational Challenges
David C. Schwartz, Michael S. Waterman |
J. Comput. Sci. Technol. | 2 |
| 2008 | An Integrative Network Approach to Map the Transcriptome to the Phenome
Michael R. Mehan, Juan Nunez-Iglesias, Mrinal Kalakrishnan, Michael S. Waterman, Xianghong Jasmine Zhou |
RECOMB | 4 |
| 2007 | Accuracy Assessment of Diploid Consensus SequencesabstractIf the origins of fragments are known in genome sequencing projects, it is straightforward to reconstruct diploid consensus sequences. In reality, however, this is not true. Although there are proposed methods to reconstruct haplotypes from genome sequencing projects, an accuracy assessment is required to evaluate the confidence of the estimated diploid consensus sequences. In this paper, we define the confidence score of diploid consensus sequences. It requires the calculation of the likelihood of an assembly. To calculate the likelihood, we propose a linear time algorithm with respect to the number of polymorphic sites. The likelihood calculation and confidence score are used for further improvements of haplotype estimation in two directions. One direction is that low-scored phases are disconnected. The other direction is that, instead of using nominal frequency 1/2, the haplotype frequency is estimated to reflect the actual contribution of each haplotype. Our method was evaluated on the simulated data whose polymorphism rate (1.2 percent) was based on Ciona intestinalis. As a result, the high accuracy of our algorithm was indicated: The true positive rate of the haplotype estimation was greater than 97 percent. Michael S. Waterman, Lei M. Li |
IEEE ACM Trans. Comput. Biol. Bioinform. | 2 |
| 2007 | On the Length of the Longest Exact Position Match in a Random SequenceabstractA mixed Poisson approximation and a Poisson approximation for the length of the longest exact match of a random sequence across another sequence are provided, where the match is required to start at position 1 in the first sequence. This problem arises when looking for suitable anchors in whole genome alignments. Gesine Reinert, Michael S. Waterman |
IEEE ACM Trans. Comput. Biol. Bioinform. | 2 |
| 2006 | Whole Genome Optical Mapping
Michael S. Waterman |
APBC | 1 |
| 2006 | Stan Ulam and Computational Biology
Michael S. Waterman |
RECOMB | 1 |
| 2006 | Refinement of optical map assembliesabstractMOTIVATION: Genomic mutations and variations provide insightful information about the functionality of sequence elements and their association with human diseases. Traditionally, variations are identified through analysis of short DNA sequences, usually shorter than 1000 bp per fragment. Optical maps provide both faster and more cost-efficient means for detecting such differences, because a single map can span over 1 million bp. Optical maps are assembled to cover the whole genome, and the accuracy of assembly is critical. RESULTS: We present a computationally efficient model-based method for improving quality of such assemblies. Our method provides very high accuracy even with moderate coverage (<20 x). We utilize a hidden Markov model to represent the consensus map and use the expectation-Maximization algorithm to drive the refinement process. We also provide quality scores to assess the quality of the finished map. AVAILABILITY: Code is available from www.cmb.usc.edu/people/valouev/ Anton Valouev, Yu Zhang 0002, David C. Schwartz, Michael S. Waterman |
Bioinform. | 4 |
| 2006 | Integrative missing value estimation for microarray dataabstractBACKGROUND: Missing value estimation is an important preprocessing step in microarray analysis. Although several methods have been developed to solve this problem, their performance is unsatisfactory for datasets with high rates of missing data, high measurement noise, or limited numbers of samples. In fact, more than 80% of the time-series datasets in Stanford Microarray Database contain less than eight samples. RESULTS: We present the integrative Missing Value Estimation method (iMISS) by incorporating information from multiple reference microarray datasets to improve missing value estimation. For each gene with missing data, we derive a consistent neighbor-gene list by taking reference data sets into consideration. To determine whether the given reference data sets are sufficiently informative for integration, we use a submatrix imputation approach. Our experiments showed that iMISS can significantly and consistently improve the accuracy of the state-of-the-art Local Least Square (LLS) imputation algorithm by up to 15% improvement in our benchmark tests. CONCLUSION: We demonstrated that the order-statistics-based integrative imputation algorithms can achieve significant improvements over the state-of-the-art missing value estimation approaches such as LLS and is especially good for imputing microarray datasets with a limited number of samples, high rates of missing data, or very noisy measurements. With the rapid accumulation of microarray datasets, the performance of our approach can be further improved by incorporating larger and more appropriate reference datasets. Jianjun Hu, Michael S. Waterman, Xianghong Jasmine Zhou |
BMC Bioinform. | 3 |
| 2005 | Alignment of Optical Maps
Anton Valouev, Yu-Chi Liu, David C. Schwartz, Yi Yang 0047, Yu Zhang 0002, Michael S. Waterman |
RECOMB | 7 |
| 2005 | HapBlock: haplotype block partitioning and tag SNP selection software using a set of dynamic programming algorithmsabstractUNLABELLED: Recent studies have revealed that linkage disequilibrium (LD) patterns vary across the human genome with some regions of high LD interspersed with regions of low LD. Such LD patterns make it possible to select a set of single nucleotide polymorphism (SNPs; tag SNPs) for genome-wide association studies. We have developed a suite of computer programs to analyze the block-like LD patterns and to select the corresponding tag SNPs. Compared to other programs for haplotype block partitioning and tag SNP selection, our program has several notable features. First, the dynamic programming algorithms implemented are guaranteed to find the block partition with minimum number of tag SNPs for the given criteria of blocks and tag SNPs. Second, both haplotype data and genotype data from unrelated individuals and/or from general pedigrees can be analyzed. Third, several existing measures/criteria for haplotype block partitioning and tag SNP selection have been implemented in the program. Finally, the programs provide flexibility to include specific SNPs (e.g. non-synonymous SNPs) as tag SNPs. AVAILABILITY: The HapBlock program and its supplemental documents can be downloaded from the website http://www.cmb.usc.edu/~msms/HapBlock. Zhaohui S. Qin, Ting Chen 0006, Jun S. Liu, Michael S. Waterman, Fengzhu Sun |
Bioinform. | 5 |
| 2003 | Haplotype reconstruction from SNP alignmentabstractIn this paper, we describe a method for statistical reconstruction of haplotypes from a set of aligned SNP fragments. We consider the case of a pair of homologous human chromosomes, one from the mother and the other from the father. After fragment assembly, we wish to reconstruct the two haplotypes of the parents. Given a set of potential SNP sites inferred from the assembly alignment, we wish to divide the fragment set into two subsets, each of which represents one chromosome. Our method is based on a statistical model of sequencing errors, compositional information, and haplotype memberships. We calculate probabilities of different haplotypes conditional on the alignment. Due to computational complexity, we first determine phases for neighboring SNPs. Then we connect them and construct haplotype segments. Also, we compute the accuracy or confidence of the reconstructed haplotypes. We discuss other issues, such as alternative methods, parameter estimation, computational efficiency, and relaxation of assumptions. Lei M. Li, Michael S. Waterman |
RECOMB | 3 |
| 2003 | Dynamic programming algorithms for haplotype block partitioning: applications to human chromosome 21 haplotype dataabstractRecent studies have shown that the human genome has a haplotype block structure such that it can be divided into discrete blocks of limited haplotype diversity. Patil et al. [6] and Zhang et al. [12] developed algorithms to partition haplotypes into blocks with minimum number of tag SNPs for the entire chromosome. However, it is not clear how to partition haplotypes into blocks with restricted number of SNPs when only limited resources are available. In this paper, we first formulated this problem as finding a block partition with a fixed number of tag SNPs that can cover the maximal percentage of a genome. Then we solved it by two dynamic programming algorithms, which are fairly flexible to take into account the knowledge of functional polymorphism. We applied our algorithms to the published SNP data of human chromosome 21 combining with the functional information of these SNPs and demonstrated the effectiveness of them. Statistical investigation of the relationship between the starting points of a block partition and the coding and non-coding regions illuminated that the SNPs at these starting points are not significantly enriched in coding regions. We also developed an efficient algorithm to find all possible long local maximal haplotypes across a subset of samples. After applying this algorithm to the human chromosome 21 haplotype data, we found that samples with long local haplotypes are not necessarily globally similar. Fengzhu Sun, Michael S. Waterman, Ting Chen 0006 |
RECOMB | 3 |
| 2001 | A new approach to fragment assembly in DNA sequencingabstractFor the last twenty years fragment assembly in DNA sequencing followed the “overlap - layout - consensus” paradigm that is used in all currently available assembly tools. Although this approach proved to be useful in assembling clones, it faces difficulties in genomic shotgun assembly: the existing algorithms make assembly errors and are often unable to resolve repeats even in prokaryotic genomes. Biologists are well-aware of these errors and are forced to carry additional experiments to verify the assembled contigs. Pavel A. Pevzner, Haixu Tang, Michael S. Waterman |
RECOMB | 3 |
| 2001 | Zinc finger gene clusters and tandem gene duplicationabstractZinc finger genes in mammalian genomes are frequently found to occur in clusters with cluster members appearing in a tandem array on the chromosome. It has been suggested that in situ gene duplication events are primarily responsible for the evolution of such clusters. The problem of inferring the series of duplication events responsible for producing clustered families is different from the standard phylogeny problem. In this paper we study this inference problem using a graph called Duplication Model that captures the series of duplication events while taking into account the observed order of the genes on the chromosome. We provide algorithms to reconstruct a duplication model for a given data set. We use our method to hypothesise the series of duplication events that may have produced the ZNF45 family that appears on human chromosome 19. Mengxiang Tang, Michael S. Waterman, Shibu Yooseph |
RECOMB | 2 |
| 1998 | Estimation for restriction sites observed by optical mapping using reversible-jump Markov chain Monte CarloabstractmoIec&r-biology technology in constructing restriction maps, Optical Mapping, has been developed by Schwartz et al. Jae Kyu Lee, Vlado Dancík, Michael S. Waterman |
RECOMB | 3 |
| 1997 | Chimeric alignment by dynamic programming: algorithm and biological usesabstractA new nearest-neighbor method for detecting chimeric 16s rRNA artifacts generated during PCR amplification from mixed populations has been developed.The method uses dynamic programming to generate an optimal chimeric alignment, defined as the highest scoring alignment between a query and a concatenation of a 5' and a 3' segment from two separate entries from a database of related sequences.Chimeras are detected by studying the scores and form of the chimeric and global sequence alignments.The chimeric alignment method was found to be marginally more effective than btuple based nearest-neighbor methods in simulation studies, but its most effective use is in concert with k-tuple methods. George A. Komatsoulis, Michael S. Waterman |
RECOMB | 2 |
| 1997 | Pooling strategies for establishing physical genome maps using FISHabstractOften, in biological studies, it is necessary to identify an organism’s chromosomes. In some organisms the individual chromosomes can be identified by staining procedures while many other species have a very large number of chromosomes, often of similar size, which defy identification by traditional staining methods. We have devised strategies, based on fluores-cent in situ hybridization (FISH), which allow the assignment of a preset number of probes to each chromosome without prior chromosome identification. By hybridizing mixtures of probes labeled with different colored fluorescent molecules, the chromosomal origin of each probe can be determined. Key words: FISH, chromosome characterization, experimental design, coupon collector problem, mathematical modeling 1. Fengzhu Sun, Gary Benson, Norman Arnheim, Michael S. Waterman |
RECOMB | 4 |
| 1996 | Alignment Networks and Electrical Networks
Martin Vingron, Michael S. Waterman |
Discret. Appl. Math. | 2 |
| 1995 | Multiple Filtration and Approximate Pattern Matching
Pavel A. Pevzner, Michael S. Waterman |
Algorithmica | 2 |
| 1994 | Linear Trees and RNA Secondary Structure
William R. Schmitt, Michael S. Waterman |
Discret. Appl. Math. | 2 |
| 1993 | A Fast Filtration Algorithm for the Substring Matching Problem
Pavel A. Pevzner, Michael S. Waterman |
CPM | 2 |
| 1993 | Sequence Comparison and Statistical Significance in Molecular Biology (Abstract)
Michael S. Waterman |
ESA | 1 |
| 1992 | Matrix Longest Common Subsequence Problem, Duality and Hibert Bases
Pavel A. Pevzner, Michael S. Waterman |
CPM | 2 |
| 1992 | Dynamic programming algorithms for restriction map comparisonabstractFor most sequence comparison problems there is a corresponding map comparison algorithm. While map data may appear to be incompatible with dynamic programming, we show in this paper that the rigor and efficiency of dynamic programming algorithms carry over to the map comparison algorithms. We present algorithms for restriction map comparison that deal with two types of map errors: (i) closely spaced sites for different enzymes can be ordered incorrectly, and (ii) closely spaced sites for the same enzyme can be mapped as a single site. The new algorithms are a natural extension of a previous map comparison model. Dynamic programming algorithms for computing optimal global and local alignments under the new model are described. The new algorithms take about the same order of time as previous map comparison algorithms. Programs implementing some of the new algorithms are used to find similar regions within the Escherichia coli restriction map of Kohara et al. Michael S. Waterman |
Comput. Appl. Biosci. | 2 |
| 1991 | Biological information signal processorabstractThe computation requirements for mapping and sequencing the human genome might soon exceed the capability of any existing supercomputer. The systolic array processor presented in this paper, called biological information signal processor (BISP), has the capability to satisfy the current and anticipated future computational requirements for performing sequence comparisons based on the T.F. Smith and M.S. Waterman algorithm (1981) as extended by M.S. Waterman and M. Eggert (1987). The BISP can conduct the most time consuming sequence comparison functions, establishing both global and local relationships between two sequences. A modified Smith and Waterman algorithm is presented in this paper for efficient VLSI implementation. Methods are developed to reduce the BISP systolic array I/O bandwidth problem by reporting only the statistical significant results. Estimated performance of the BISP is compared with several different computer architectures.> E. T. Chow, Tim Hunkapiller, J. Peterson, Michael S. Waterman |
ASAP | 4 |
| 1991 | A systolic array processor for biological information signal processingabstractThe Biological Information Signal Processing (BISP) is a system for high speed sequence comparisons designed to support the computation requirements for mapping and sequencing the human and other genomes. The heart of a BISP system is a versatile processor chip that can conduct the most time consuming sequence comparison functions, establishing both global and local relationships between two DNA or protein sequences. Because of \nthe application’s strong computation and communication \nrequirements, a programmable systolic array architecture was \ndeveloped. A BISP system can include a large number of \nprocessing elements; the initial BISP demonstration system \nconsists of 768 BISP elements, capable of delivering more than 6.25 x 10^9 integer operations per second. The system can be expanded to include over 4,000 elements, This paper describes the comparison algorithm and outlines the BISP chip and system designs. Estimated performance of the BISP system is compared with several different computer architectures. E. T. Chow, John C. Peterson, Michael S. Waterman, Tim Hunkapiller, Barbara A. Zimmermann |
ICS | 3 |