JamesJava

How Trello is different - Joel on Software

2012-01-06T11:09:00.000-06:00

How Trello is different - Joel on Software: 'A feature that you built and tested, but didn’t deliver yet because you’re waiting for the next major release, becomes inventory. Inventory is dead weight: money you spent that’s just wasting away without earning you anything.'

Are older people better programmers? | Javalobby

2011-07-19T08:45:00.000-05:00

Are older people better programmers? | Javalobby: "Fast programmers who produce disorganized code rely on their superior short term memory to get things done. These programmers get worse with age as their short-term memory weakens. They tend to drop out of the field.
Slow programmers who produce well-organized and readable code avoid relying on short-term memory. They tend to get faster and better with age as they accumulate in their long-term memory an ever increasing portfolio of strategies, patterns and techniques."

Ignore the customer experience, lose a billion dollars (Walmart case study) - Good Experience

2011-04-13T15:53:00.000-05:00

Ignore the customer experience, lose a billion dollars (Walmart case study) - Good Experience: "The mistake was a lack of customer focus. I know, I know: 'They ran a survey! Customers loved the idea!' But that's exactly the problem. Walmart didn't pursue the question of what customers wanted. Instead, Walmart came up with the answer first, then asked customers to agree to it. That's exactly the wrong thing to do, because it ignores customers while attempting to fool stakeholders into thinking that the strategy is customer-centered.

Put another way, Walmart based this incredibly expensive misadventure on what customers said, rather than what they did. And the customer experience is all about what customers do. In real life. No hypotheticals. Walmart acted without considering the customer experience, and that was a big mistake."

France Outlaws Hashed Passwords - Slashdot

2011-04-08T10:05:00.000-05:00

France Outlaws Hashed Passwords - Slashdot: "'Storing passwords as hashes instead of plain text is now illegal in France, according to a draconian new data retention law. According to the BBC, '[t]he law obliges a range of e-commerce sites, video and music services and webmail providers to keep a host of data on customers. This includes users' full names, postal addresses, telephone numbers and passwords. The data must be handed over to the authorities if demanded.'"

Can java.util.concurrent.lock.Lock detect deadlocks caused by two threads acquiring the same locks in a different order

2010-12-29T10:33:00.003-06:00

Could java.util.concurrent.lock.Lock detect deadlocks caused by two threads acquiring the same locks in a different order?

Could it use a static list of all threads that have locks and ThreadLocal locks lists to know about all in use locks and then check for incorrect order when lock() is called.

In lock:
Check the ThreadLocal list and if there are no other locks then proceed.
Else if there are other locks then look through other threads to determine if any have any of the same locks in a different order.
Add current lock to ThreadLocal list.

In unlock:
Remove current lock from ThreadLocal list.

Format for design and requirements

2010-10-21T09:48:00.002-05:00

Do a "requirements document" and "design document" use an outdated format? Is one monolithic document the right way to handle that information? Are there better ways to handle that information?

Consider this idea:
Keep requirements/design info in a tree structure.
Support viewing the whole tree to a specific depth so that people can ignore undesired detail.
Allow ownership to be set by branch.
Allow editing each node separately so there is less chance for conflict.

Stephen Colebourne's: Oracle, Google and the politics of money

2010-08-13T12:14:00.000-05:00

Stephen Colebourne's Weblog: "On the specifics of the lawsuit I have little to say. Google undoubtably have sailed close to the wind. But did they cross the line? Well, thats for lawyers now. The problem I have is not that there was something to discuss, but that Oracle thinks that this approach will improve their position. For me it shows how out of touch they are with how community and sentiment works outside CxO level politics.

The lawsuit is likely to shine a bright light on the OpenJDK too. Anyone who has contributed to the project known as 'OpenJDK 7' should now be concerned about whether their work will ever be freely available as open source."

BatchGeo - Make google maps using many addresses / coordinates

2010-03-05T21:31:00.000-06:00

BatchGeo - Make google maps using many addresses / coordinates: "Is your data is in a spreadsheet? Well try this free and unique tool to...
Map it using Google Maps"

Looks quite useful!

IBM rethinks industry-standard servers | Business Tech - CNET News

2010-03-02T08:10:00.000-06:00

IBM rethinks industry-standard servers | Business Tech - CNET News: "Big Blue's new family of servers, dubbed the eX5 portfolio, features architecture tweaks that allow the customer to add more memory without buying an entirely new server."

Am I misunderstanding, or is IBM just now adding a feature that PC's have had for decades?

A Little Less Conversation

2010-01-22T15:32:00.000-06:00

A Little Less Conversation: "In 2006, Moishe Lettvin, a former programmer at Microsoft, wrote a blog post describing the year he spent coordinating the list of items that would be featured on one menu in Windows Vista -- the menu you use to turn off your computer. (See The Windows Shutdown Crapfest.) Lettvin figured that 43 people all had a voice in designing this one menu. Forty-three! By Brooks's formula, that means managing 903 connections. Lettvin says he spent so much time on coordination tasks that, in 12 months, he produced fewer than 200 lines of code."

Official Google Blog: Browser Size: a tool to see how others view your website

2009-12-31T13:18:00.000-06:00

Official Google Blog: Browser Size: a tool to see how others view your website: "Browser Size is based on a sample of data from visitors to google.com. Special code collects data on the height and width of the browser for a sample of users. For a given point in the browser, the tool will tell you what percentage of users can see it. For example, if an important button is in the 80% region it means that 20% of users have to scroll in order to see it. If you're a web designer, you can use Browser Size to redesign your page to minimize scrolling and make sure that the important parts of the page are always prominent to your audience."

TLS (SSL) compromised!

2009-11-05T11:42:00.000-06:00

extendedsubset.com: "There are three general attacks against HTTPS discussed here, each with slightly different characteristics, all of which yield the same result: the attacker is able to execute an HTTP transaction of his choice, authenticated by a legitimate user (the victim of the MITM attack). Some attacks result in the attacker-supplied request generating a response document which is then presented to the client without any certificate warning or other indication to the user. Other techniques allow the attacker to forward or re-purpose client certificate authentication credentials."

Open source as an antitrust strategy | The Open Road - CNET News

2009-11-02T13:35:00.000-06:00

Open source as an antitrust strategy | The Open Road - CNET News: "IBM, Intel, Red Hat, and others aren't investing in Linux because they're all chums at the country club together, but rather because they're looking for ways to reduce Microsoft's hold on their own businesses through its control of personal computer and server operating systems.
As an added benefit, it's a great way for companies to collaborate without running afoul of antitrust laws. It's collusion without the collusion."

Google Public Policy Blog: Vint Cerf on the importance of keeping the Internet open

2009-10-21T10:39:00.000-05:00

Google Public Policy Blog: Vint Cerf on the importance of keeping the Internet open: "Earlier this week, Vint Cerf, one of the original architects of the Internet and our Chief Internet Evangelist, joined other pioneers in a letter to the FCC expressing support for the Commission's consideration of safeguards that would preserve the open Internet."

Government regulation will mean that it isn't open! Once the government takes control it will only increase its control and the regulation will limit good experimentation.

[JavaSpecialists 177] - Logging Part 3 of 3

2009-10-13T06:58:00.000-05:00

[JavaSpecialists 177] - Logging Part 3 of 3: "For example, here is a Layout for Log4J that can be used to collapse lines with '|>>' instead of a newline character. For readability, it is trivial to then replace those characters with \n again."

import org.apache.log4j.*; import org.apache.log4j.spi.*;  import java.io.*;  public class MultipleLineLayout extends Layout {   public String format(LoggingEvent event) {     Object o = event.getMessage();     if (o instanceof Throwable) {       return format((Throwable) o);     }     return format(String.valueOf(event.getMessage()));   }    private String format(Throwable t) {     StringWriter out = new StringWriter();     PrintWriter pw = new PrintWriter(out);     t.printStackTrace(pw);     pw.close();     return format(out.toString());   }    private String format(String s) {     return s.         replaceAll("\r", ""). // remove Windows carriage returns         replaceAll("\n*$", ""). // remove trailing newline chars         replaceAll("\n", " |>> ") // replace newline with |>>         + "\n";   }    public boolean ignoresThrowable() {     return false;   }    public void activateOptions() {     // not necessary   } }

Microsoft bashes Google's Chrome-in-IE plan | Beyond Binary - CNET News

2009-09-24T14:23:00.000-05:00

Microsoft bashes Google's Chrome-in-IE plan | Beyond Binary - CNET News: "'Given the security issues with plug-ins in general and Google Chrome in particular, Google Chrome Frame running as a plug-in has doubled the attach area for malware and malicious scripts. This is not a risk we would recommend our friends and families take.'
However, some took Microsoft to task for criticizing plug-ins, noting that Redmond itself has more than a few.
'Microsoft scared of security of plug-ins. Uninstall Silverlight now,' Mozilla's Dion Almaer wrote in a Twitter posting."

It's not like MS or IE has a stellar security record.

Distributed Relational Database Architecture

2009-09-08T08:23:00.000-05:00

Distributed Relational Database Architecture

James Stauffer

August 1, 2009

Prepared for CS425 Summer 2009

Table of Contents

I. Introduction

A. Focus

B. Implementation

II. Relevent Features

A. Availability

B. Failover

C. Replication

D. Partitioning

E. Single Point of Failure

F. Shared Storage

G. Inter-node Communication

III. Shared Everything: Oracle RAC (Real Application Cluster)

A. Maintenance availability

B. Inter-node communication

C. Permanent Storage

D. Client interaction

E. Further information

IV: Shared Nothing: My SQL Cluster

A. Maintenance availability

B. Inter-node communication

C. Permanent Storage

D. Client interaction

E. Further information

V. Sharding

A. Maintenance availability

B. Inter-node communication

C. Permanent Storage

D. Client interaction

E. Further information

VI. Conclusion

Introduction
1. Focus

This paper will cover distributed relational database architecture, primarily as it affects availability to the client. Features that allow the database to run more complex queries or handle larger data sets (scalability) will not be covered. All discussion will focus on systems with multiple servers (call nodes) involved.

Implementations

This paper will cover three basic types of implementations: Shared Everything, Shared Nothing, and Sharding. Shared Everything implementations don't actually share everything but just share the data storage between nodes, while shared nothing systems have nodes that are completely independent (including storage) and self-sufficient. Systems that present the nodes as one or as interchangeable are generally called clusters and include shared everything and shared nothing. Sharding is similar to shared nothing in that nothing in the nodes is shared, and the nodes are independent. However, sharding nodes are seen as completely separate and independent (but related) by the client. Shared everything systems need to synchronize data access and can do it either through a shared storage device or with direct communication. Oracle RAC will be the example reviewed for shared everything, and MySQL will be the example reviewed for shared nothing. Sharding doesn’t have specific support in any major database, so it will be generically reviewed with no example. For each type of architecture, the following will be addressed: maintenance availability, inter-node communication, permanent storage, and client interaction.

Relevant Features

Some major aspects relevant to highly available distributed relational database architecture include: availability, failover, replication, partitioning, single point of failure, shared storage, and inter-node communication.

Availability

Availability refers to the percent of time that a service is responsive and working correctly (synonymous with uptime). It is usually expressed in a percent with 99.999% (5 nines) considered a very high level of availability. Downtime refers to the time that a service is not available (i.e. the opposite of availability). Both planned and unplanned events can affect availability, therefor both need to be addressed. All types of database systems try to minimize unplanned downtime to some extent, but vary in how much maintenance can be done without downtime. Techniques to minimize unplanned downtime include: automatic transferring of connections from failed to working nodes, automatic restart of failed nodes/services, and optimal checkpointing to minimize restart time. Techniques to minimize planned downtime include supporting maintenance operations while the service running is one of the following: allowing patches, updates, reconfiguration, adding or removing nodes, adding or removing databases.

Failover

Failover refers to what happens when one node fails, and how another node (or nodes) starts handling the service that had been provided by the failed node. Failover may be mostly transparent to the client, or can require the client to connect to another node. The client can have a front-end, such as a JDBC driver, that can handle some of the cluster activity (i.e. connecting to another node if the cluster doesn't handle that automatically). Whether or not the client is automatically redirected to another node, any transactions open on the failed node will also fail.

Replication

Replication refers to the copying of data to another system or node – especially so that when a node fails, no data is lost and the data is immediately available. Asynchronous replication happens in the background so that the client receives the result of its request much quicker, and does have the risk that the node will fail before all data is replicated. Synchronous replication happens before the result is sent back to the client, but makes each client request take longer. There can also be multiple levels of replication. Replication can be done to the memory of two nodes synchronously to provide fast response (and minimilize the chance of data loss): and asynchronous replication can be made to permanent storage.

Partitioning

Partitioning refers to splitting the data into parts, and distributing each part to a separate node. This allows each node to have less data to handle. One problem, however, is that it can cause the need for requests to contact many nodes in which to access all needed data. Therefore, partitioning may not be appropriate for all types of databases. When a node has less data to handle, it can more effectively cache data in memory, it can have more efficient indexes, and therefore it can increase performance.

Single point of failure

A single point of failure is a single component of the system that is used by the whole system, and if that component fails, the whole system will fail. A system with a single point of failure is much more at risk for failure, therefor a single point of failure should be avoided. In a highly available system, as many components as possibleare duplicated to help avoid as many single points of failure as possible. Even when nodes are duplicates, components on each node are often duplicated to reduce the chance of failure on an individual node (i.e. network interface, storage interface, power supply, etc). The single point of failure assessment is done on many levels – from the storage system (drives, connectors, controllers, power), all the way up to datacenter power and network connection.

Shared storage

Shared storage is permanent database storage that is shared between all or many nodes. Like anything else shared, shared storage can be a risk as a single point of failure. Shared storage can also be used as a communication channel. Types of shared storage include a database (however, using a database for shared storage of a database isn't used), NAS(Network attached storage), SAN(Storage Area Network), external SCSI disk, cloud storage (such as Amazon S3), etc. The connection to the shared storage is generally duplicated (i.e. two network cards, SCSI controllers, etc). The single point of failure risk can be addressed by duplicating the data into two identical shared storage systems through a process called mirroring.

Inter-node communication

Inter-node communication refers to how the nodes communicate with each other. Nodes can communicate through shared storage, or over a network. When communication is over a network, it is generally a fast network (gigabit or faster), a network that is private to the nodes (accessed only by the nodes), and a network that is called an interconnect. Each node generally has two network interfaces for improved fault tolerance. Because the network is slower than memory, the inter-node communication of a cluster can make each action slower in a cluster, as opposed to communication on a single database.

Shared Everything: Oracle RAC (Real Application Cluster)
1. Maintenance Availability

Adding a new node to the cluster doesn't involve cluster downtime, however clients may not completely use the new node until they are told about it. Some actions, like parallel queries, will immediately take advantage of the new node. All cluster nodes can be managed as one, or managed separately, as deemed necessary. Some code upgrades (patches) to the DBMS (database management system) can be applied to the cluster. This is done one node at a time, in a rolling fashion, so that all nodes can be upgraded without service downtime.

Inter-node Communication

The nodes communicate updates (for cache), locking, etc. between each other over an interconnect (older versions communicated over the file system). When a node needs to write to a data block, it first sends a request across the cluster to transfer ownership of the data block to itself. It appears that each cluster has a master that tracks which node owns each block, therefor this design doesn't slow a single update as nodes are added to the cluster because ownership transfer only involves threenodes: requester, master, and current owner. Since only one node can own a block at one time, blocks that are updated often can cause ownership to jump around between nodes, often degrading performance.

Permanent Storage

Oracle RAC uses shared storage. The shared storage can be NAS, SAN, or SCSI disk. ASM (Automatic Storage Management) can address the storage single point of failure risk by mirroring data across different failure groups (a set of disks sharing something in common, such as a controller). Since the file system is shared, all volume management must be designed to work with the cluster.

Client Interaction

Clients connect to the nodes with Virtual IP (VIP) addresses so that if a node fails, the VIP can be redirected to another node. The client needs to know the VIP for all nodes. Clients can use Fast Application Notification (FAN), Fast Connection Failover (FCF), and Transparent Application Failover (TAF) to detect and/or handle node failure. However, it may require the client to re-do some work, and it may be hard to determine which options are current, and which options will work best. It can be a huge code change to change a program to detect and redo actions every place that the database is used. Load balancing is supported by the client having the list of all nodes, and randomly choosing a node for a connection (so that connections are spread across nodes). Alternatively, the client can get load information from the listener running on the chosen node. This is done so that the listener can direct the client to another node that has more resources available (which all depends on the connection option chosen.)

Further Information

http://en.wikipedia.org/wiki/Oracle_RAC

http://www.oracle.com/technology/products/database/clustering/index.html

Shared Nothing: MySQL Cluster

A MySQL cluster has 3 node types: data nodes to store the data, SQL nodes to run a MySQL server, and management nodes. Therefore a minimum of five nodes is generally needed for high availability (1 management, 2 SQL, and 2 data each with 1 replica of the data).

Maintenance Availability

Adding and dropping data nodes requires that the cluster be restarted. One exception is that data nodes for new partitions can be added while the cluster is running. If one node fails, failover automatically happens to another node, and any transaction information on the failed node is lost. The failover only takes sub-second time to happen. Adding space to an existing database by adding a data node, requires that the data be repartitioned to include the new node (so that the data is spread out over the new set of nodes). Therefore, adding and repartitioning causes downtime and uses a lot of resources. Rolling software updates are supported.

Inter-node Communication

Nodes communicate on a private interconnect. Because there is only one primary owner of each block (the primary replica), ownership of the block doesn’t need to be transferred, and updates only have to involve 2 nodes (the SQL node processing the request, and the master data node that owns the block).

Permanent Storage

The data is partitioned across the data nodes. Each piece of data can have multiple replicas (with one node being the master, and the others being slaves) so that the data exists on multiple nodes, and so that there is no single point of failure. When a node needs to write a block, it can replicate the data either asynchronously or synchronously. If the node is configured to replicate asynchronously, it first replicates the data to all other data nodes that have a replica, and then asks them if they can commit the change. If all reply affirmatively,the node then sends another message to tell all other nodes to commit the change (two phase commit). Since the data is replicated to other nodes, each node can replicate to permanent storage asynchronously.

Client Interaction

Clients can connect to the cluster through a load balancer, or through a proxy, so that they don't have to be aware of the individual SQL nodes. Client reads can be done on the replicated nodes to provide better performance because the access can be spread out over more data nodes. Read and write lock conflicts can also be reduced if the masters are setup to only handle writes, and the slaves only handle reads. The reduced contention also increases performance.

Further Information

http://en.wikipedia.org/wiki/MySQL_Cluster

http://dev.mysql.com/doc/refman/5.1/en/mysql-cluster.html

http://dev.mysql.com/doc/refman/5.1/en/mysql-cluster-replication.html

http://dev.mysql.com/doc/refman/5.1/en/replication.html

Sharding
1. Maintenance Availability

Since each shard is independent, all maintenance on one shard has no affect on the rest of the shards. The only exception is if the data needs to be repartitioned across the shards, then all shards can be affected. However, repartitioning can be done without affecting availability. Adding a shard can also require repartitioning. Sharding takes more work to manage because of the work involved in repartitioning to keep the load balanced, or when adding or removing a shard. Each shard could have many of the techniques for normal clusters used, but they are used independently, so any bottlenecks are for a smaller data set. Balancing the load between servers can be difficult. For example, some users may use more resources, thus using some shards much more than others.

Inter-node Communication

There is no inter-node communication with sharding, and problems on one server can't affect other servers.

Permanent Storage

Sharding splits the data into partitions/shards (i.e. by groups of users) and puts each portion on a completely separate DB system. This removes write bottlenecks across shards without the potential for data inconsistency. There is no specific storage architecture since each shared can use any storage architecture.

Client Interaction

The client either has to know the sharding algorithm (so that the client knows which shard to contact), or there must be a shard lookup service that the client uses. The shard lookup service will have the potential to be both a single point of failure, and a bottleneck (however, it should be used much less so that it isn't a bottleneck). Determining the correct shard to contact can increase the complexity of the client code. Also, queries across groups are more difficult, therefore, systems that require a lot of queries across shards may not work well with a sharding system.

Further Information

http://highscalability.com/unorthodox-approach-database-design-coming-shard

Conclusion

Sharding has the highest maintenance availability, MySQL cluster has the lowest maintenance availability. Sharding has the lowest inter-node communication, Oracle cluster has the highest inter-node communication. MySQL cluster has the most fault-tolerant permanent storage, sharding has the least fault-tolerant. MySQL cluster has the least complex client interaction, Oracle RAC has the most complex. Depending on the exact features needed, and the type of data used, each could be the best solution However, for this focused comparison, MySQL cluster provides the best combination.

Bill would give president emergency control of Internet | Politics and Law - CNET News

2009-08-28T10:50:00.000-05:00

Bill would give president emergency control of Internet | Politics and Law - CNET News: "The new version would allow the president to 'declare a cybersecurity emergency' relating to 'non-governmental' computer networks and do what's necessary to respond to the threat. Other sections of the proposal include a federal certification program for 'cybersecurity professionals,' and a requirement that certain computer systems and networks in the private sector be managed by people who have been awarded that license."

Why should we expect the executive branch to have the expertise and information to know how to best use that control?

Defeating Character Frequency Analysis of Substitution Ciphertext

2009-08-04T23:02:00.000-05:00

(This is a paper I wrote in the fall of 2008 for CS461: Computer Security I at UIUC. If you are interest in the code leave a comment and contact info.)

Introduction

Character frequency analysis is a common way to crack substitution ciphertext because of the uneven distribution of letters in languages. In order to defeat that analysis, the techniques considered were: synonyms, dropping letters or words, adding extra letters or words, alternate spelling (Leet, spam, etc), and Two cipher letters per plaintext letter. Most of these techniques would be applied before a standard substitution cipher encryption. To evaluate the techniques, test data was obtained from Project Gutenberg(http://www.gutenberg.org/) and consisted of the texts of Psalms (Ps), Pride and Prejudice (P&P), Alice in Wonderland (AiW), and Sherlock Holmes (SH). After applying the technique, the output character frequency was compared to the standard character frequency (http://en.wikipedia.org/wiki/Letter_frequencies and http://www.data-
compression.com/english.html) and then the standard deviation of the proportion of the changed frequency for each letter compared to the standard character frequency. i.e. If the letter "e" occurred 10% of the time in the changed text then the proportion for "e" is .787 (.10/.12702). That gives an overall measure of how close the changed text character frequency is to the standard character frequency. A standard deviation of 0% would mean that it exactly matches the standard frequency. Initial standard deviations are: Ps: 25%, P&P: 28%, AiW: 25%, SH: 14%. For comparison, an equal distribution produces a standard deviation of 1,439%. In LetterFrequencies.zip there are programs for most of these options and for computing the standard deviation.

Synonyms

Replacing words with synonyms that have a higher standard deviation can help defeat character frequency analysis. The thesaurus used has synonyms in categories, so when a word was looked up, the first category was arbitrarily used. Within the first category, the word that had the largest standard deviation from the normal character frequency was chosen. The chosen work often didn't fit grammatically, so the results are skewed, but this is somewhat offset by only looking in the first category. To make this usable, grammar checking would have to be used. It would probably need a UI that would suggest alternatives (based on grammar rules and the standard deviation). Attacks against this technique could include creating a list of the best synonyms, creating a new standard character frequency distribution for those words, and therefore largely defeat the benefit of this technique. Final standard deviation achieved: Ps: 182%, P&P: 180%, AiW: 135%, SH: 149%. The increase in standard deviation was very significant, but not enough to make a large impact on frequency analysis.

Dropping letters or words

Randomly dropping letters or words could easily hide the meaning from the intended recipient so it would be hard to keep the meaning while still randomly dropping enough to make an impact. An attempt to always drop vowels and rare letters (a,e,i,o,u,x,q) and words (I, the, is, was, of, a, & an) made an insignificant difference (Drop Words Ps: 8%, P&P: 6%, AiW: 8%, SH: 8%; Drop Letters: Ps: 73%, P&P: 91%, AiW: 69%, SH: 70%). Also, some of each letter would need to be dropped to prevent the non-dropped letters from serving as landmarks.

Adding extra letters or words

To be effective, extra letters and words must be randomly placed. They could be chosen based on the inverse of distribution. However, additions that have a significant impact on the standard deviation may garble the message too much. Add letters results(based on inverse of distribution): P&P: 2,154%, SH: 2,795%. The result is readable but takes significantly more work to understand the message.

Alternate spelling (Leet, spam, etc)

Alternate spelling includes l33t (http://en.wikipedia.org/wiki/Leet) and spam spelling (http://en.wikipedia.org/wiki/E-mail_spam#Obfuscating_message_content) and is similar to synonyms, in that the possibility of a new new standard character frequency has to be taken into account. This technique was not implemented or programatically evaluated because it was non-obvious what to use as the standard distribution.

Two cipher letters per plaintext letter

Using two letters in the cipher text for each letter in the plaintext can be a good way to create a flat character distribution. The algorithm is to partition the 676 2-letter combinations based on the standard character frequency. i.e. if the standard frequency for a letter is 5% then it will get 5% of the 2-letter combinations (randomly selected). This doubles the size of the data, could include spaces & punctuation, and makes a much larger key. Note that some letters may get dropped because they occur less than 1/676 (0.15%) of the time. Both 1-gram and 2-gram frequency analysis produce a nearly uniform histogram (variation appears to only be caused by rounding). Two-gram results: P&P=5,117%; SH=5,013%. Therefore this technique was extremely effective with no obvious weaknesses.

Conclusion

Changing the plaintext proved problematic because of inadvertent changes to the meaning, but it did make a significant impact on standard deviation even though it probably wasn't significant enough. Applying all of the plaintext changes to a short message while using safeguards to protect the meaning would probably be effective. Two cipher letters per plaintext letter appears to be the easiest way to defeat character frequency analysis.

Sample chapter from Don't Make Me Think

2009-07-31T14:06:00.000-05:00

Sample chapter from Don't Make Me Think: "Why are things always in the last place you look for them?
Because you stop looking when you find them.
—Children’s riddle"

Great info on usability.

Pressure sensitive keyboard for repeat rate

2009-07-30T09:43:00.002-05:00

Would it be helpful to have a pressure sensitive keyboard where the pressure determines the repeat rate (harder=faster, etc)? It seems that it would be especially useful for navigation keys (arrow, page up/down) and keys commonly repeated (enter, backspace, delete, space, tab). Does such a thing exist? Was it tried and how well did it work?

Ex-Google CIO breaks his own security rules | InSecurity Complex - CNET News

2009-07-29T20:46:00.000-05:00

Ex-Google CIO breaks his own security rules | InSecurity Complex - CNET News: "But 'it's not security's responsibility to go out there and say 'Users want to use Gmail. Let them use it,'' Johnson added. 'If we decide to use Gmail we need to have a project and treat it in a formal way and pay money to do it right.'"

So are you going to have a project for every website that users might find useful? There is no way that you will keep up and the barrier to using useful websites will significantly hurt productivity.

Beyond the hype: Where open source actually saves you money | The Open Road - CNET News

2009-07-29T16:37:00.000-05:00

Beyond the hype: Where open source actually saves you money | The Open Road - CNET News: "One way, as Urlocker points out on his blog, is that open source allows enterprise IT projects to succeed or fail with little risk. You know before you pay anything--if you pay anything--that open-source software is going to work, or not."

"Open source tends to offer best-of-breed solutions that aim to do a limited range of functions well, rather than to be all things to all people."

MIT OpenCourseWare | Electrical Engineering and Computer Science | 6.854J Advanced Algorithms, Fall 2008 | Home

2009-07-25T22:38:00.000-05:00

MIT OpenCourseWare |

Electrical Engineering and Computer Science | 6.854J Advanced Algorithms, Fall 2008 | Home: "This is a graduate course on the design and analysis of algorithms, covering several advanced topics not studied in typical introductory courses on algorithms. It is especially designed for doctoral students interested in theoretical computer science."

Pattern Formatter for java.util.logging

2009-06-22T12:53:00.000-05:00

Pattern Formatter for java.util.logging: "The Log Formatter will use the following formatting tokens:

* LoggerName %LOGGER%
* Level %LEVEL%
* Time %TIME%
* Message %MESSAGE%
* SourceClassName %SOURCECLASS%
* SourceMethodName %SOURCEMETHOD%
* Exception Message %EXCEPTION%"

Save Icon

2009-05-07T12:10:00.002-05:00

The most common save icon is a picture of a floppy disk.

But with floppy disks not being used anymore will most programs change the picture? In 1-2 decades what picture will be used for save icons?

FBI seizures highlight law as cloud impediment | The Wisdom of Clouds - CNET News

2009-04-16T13:08:00.000-05:00

FBI seizures highlight law as cloud impediment | The Wisdom of Clouds - CNET News: "The articles report that the FBI raided at least two Texas data centers last week, serving search and seizure warrants for computing equipment, including servers, routers, and storage. The FBI was seeking equipment that may have been involved in fraudulent business practices by a handful of small VoIP vendors.
The problem is that they didn't just grab the systems belonging to the VoIP vendors, but grabbed hundreds of servers serving a wide variety of businesses, the vast majority of which had never dealt with or even heard of the companies under investigation, according to Threat Level. Company officials interviewed complained of losing millions of dollars in lost revenue and equipment with no warning whatsoever."

"If the court upholds that servers can be seized despite no direct warrants being served on the owners of those servers (or the owners of the software and data housed on those servers), then imagine what that means for hosting your business in a cloud shared by thousands or millions of other users."

"Here is what I argue must happen:
The law must respect digital assets in the same way that it respects physical assets. This means that search and seizure rules should apply to data and software run on third party infrastructure (or wholly owned infrastructure run in third party facilities) in the same way that they protect my home and personal property if I rent an apartment in a building housing hundreds of tenants. The fact that one tenant commits a crime is not enough for the civil liberties of all of the other tenants to be null and void. I argue the same goes for digital assets "renting" space in the cloud.
The federal government should adopt a cloud computing bill of rights. (Here is a rudimentary example.) Each state should as well. Declare loud and clear that you suffer little or no loss of rights if you choose to run your business in the cloud over running it within your own facilities. Repeal or revise the laws that make it impossible for foreign businesses and governments to allow communications and data to pass within U.S. borders (including relevant elements of the Patriot Act).
It is time for our policy makers to step up and really understand the influence that the Internet and cloud computing will have on the future growth of this country. It is scary how little technical understanding most congressional and senate members have. However, that alone is not an excuse for not grasping the policy gaps that are brought about as our commerce and society rely increasingly upon Internet-based services."

Performance tuning technique number 91: Do not allocate memory during the main game loop

2009-03-30T17:53:00.001-05:00

Performance tuning technique number 91: Do not allocate memory during the main game loop

Caching strategy

2009-01-28T12:07:00.000-06:00

Generally Least Recently Used (LRU) is considered a good strategy for removing items from the cache. Instead it might be useful to measure the cost (i.e. time) to produce a cache item, and how many hits that item gets and then remove the item that has the lowest value of hits * cost.

A quick Google search didn't find anything like this. Comments?

Lego Mindstorm NXT program

2008-11-01T09:51:00.002-05:00

I temporarily had a Lego Mindstorm NXT and wrote the following program for it using LeJOS. Enjoy:

import java.util.*;

import lejos.nxt.*;

import lejos.util.*;

public class Dingbot {

public static void main (String[] aArg) throws Exception {

new ButtonWatcherThread(new TimerListener() {

public void timedOut() {

running = !running;

}

}).start();

motorRight.smoothAcceleration(true);

motorLeft.smoothAcceleration(true);

final float circumference = 17.5f;

final int distanceBuffer = 50;

final int rotateDistance = 80;

UltrasonicSensor distSensor = new UltrasonicSensor(SensorPort.S4);

LightSensor litSensor = new LightSensor(SensorPort.S2);

litSensor.setFloodlight(true);

LCD.drawString("Hi",1,1);

int startTime = (int)System.currentTimeMillis();

boolean blinkLight = true;

Random random = new Random();

while(startTime + 60*1000 > (int)System.currentTimeMillis()) {

if(running) {

int cmDist = distSensor.getDistance();

while(running && cmDist > distanceBuffer) {

LCD.drawString(" ",1,2);

LCD.drawInt(cmDist,1,2);

int distance = cmDist - distanceBuffer;

if(distance > 5) {

distance = 3;

}

int degrees = (int)(360 * distance / circumference);

setSpeed();

motorRight.rotate(degrees, true);

motorLeft.rotate(degrees, true);

cmDist = distSensor.getDistance();

litSensor.setFloodlight(blinkLight);

blinkLight = !blinkLight;

LCD.drawInt(litSensor.readNormalizedValue(),1,4);

}

boolean turnPositive = random.nextBoolean();

while(running && cmDist <>

LCD.drawString(" ",1,2);

LCD.drawInt(cmDist,1,2);

setSpeed();

if(turnPositive) {

motorRight.rotate(180);

} else {

motorRight.rotate(-180);

}

cmDist = distSensor.getDistance();

}

} else {

try {

Thread.sleep(500);

} catch(InterruptedException ie) {

//Ignore

}

public static void setSpeed() {

int soundLevel = sound.readValue();

LCD.drawString(" ",1,3);

LCD.drawInt(soundLevel,1,3);

int speed = (100 - soundLevel) * 9;

motorRight.setSpeed(speed);

motorLeft.setSpeed(speed);

}

static Motor motorRight = Motor.B;

static Motor motorLeft = Motor.C;

private static SoundSensor sound = new SoundSensor(SensorPort.S1);

private static boolean running = false;

}

class ButtonWatcherThread extends Thread {

public ButtonWatcherThread(TimerListener tl) {

this.tl = tl;

this.setDaemon(true);

}

public void run() {

wasPressedLast = touchSensor.isPressed();

while(true) {

boolean isPressed = touchSensor.isPressed();

if(wasPressedLast != isPressed) {

if(isPressed) {

tl.timedOut();

}

wasPressedLast = isPressed;

}

try {

Thread.sleep(100);

} catch(InterruptedException ie) {

//Ignore

}

private TimerListener tl;

private boolean wasPressedLast;

private TouchSensor touchSensor = new TouchSensor(SensorPort.S3);

}

Why do geeks celebrate Christmas on Halloween?

2008-10-31T16:44:00.001-05:00

Because Oct. 31 = Dec. 25

Digital money

2008-10-02T11:33:00.004-05:00

I think digital money should have these features:

Hard to counterfit
Hard to duplicate (and use twice)
Easy to transfer to another person with minimal involvement of a 3rd party
Easy to use, track, store, verify, etc
Transaction fees must be very, very low.
Minimal Big Brother tracking.

Here is one idea for how to accomplish that:
A user would go to a website and enter payment info and the website would send the user an image file. The file would be a picture of the amount of money that it represents (for ease of use) and would have comments in it that record the originating website, amount and any other needed info. The website would generate the image so that is unique (i.e. the bits are unique) and would store the image bits and amount in a database. The file would have to be large enough so that a brute force attempt to generate random files would be too expensive.
When the user needs to split an amount (make change), they would send it to the website and request the new amounts. The website would verify that it was valid (in their DB), send new image files to the user, and delete the record for the old file.
When the user needs to send money to another person they would just get the correct amount (using splitting or multiple files) and send those files to the other person. The other person would send them to the website to get their own files so that the old file is invalid and they have a valid file. Once the other person saw that they were valid they would complete the transaction with the first person.
Verification consists of sending to the website to get an new file. If the file was invalid the webiste would just give an error message. Anytime a user receives money from another user they must verify it (get a new file) to make sure that it is valid.
The user could cash out the file by going to the website and requesting payment.
Transaction fees would be limited to the initial payment and requesting payment.

The user could have requested multiple files with various amounts to make it easier.
If someone tries to make a copy of the file in order to use it twice only the first copy would be validated.

The user would need to remember to not make any changes to the image (i.e. rotation) because that would invalidate the file. Therefore the image formats that Windows Explorer can rotate should be avoided or the files always marked as read-only.

This idea could work for trading anything (different currencies, stocks, etc). Each website would have its own file type but websites or users could translate between the different file types.

Comments?

Spell check what others write

2008-08-06T15:21:00.002-05:00

I think programs should spell and grammer check what others wrote. i.e. If I am reading a webpage it should have some way of marking bad spelling or grammer with a way to see suggested improvements. That would allow me to understand the intent better when the grammer or spelling is poor.

Do you agree that adding this feature to browers, IM clients, etc would be useful?

XSL: Preserving line feeds, tabs, and spaces in data while still wrapping text

2008-06-16T11:51:00.002-05:00

I had data in XML that had line feeds, spaces, and tabs that I wanted to preserve (so I couldn't use

) but I also wanted the lines to wrap when the side of the screen was reached (so I couldn't use

).

After some research and help from a co-worker (Patricia Eromosele) I made the XSL template below that achieves that. An example of how to call it follows:


    <p>
                    <xsl:call-template name="prewrap">
                      <xsl:with-param name="text" select="text"/>
                    </xsl:call-template>
    </p>

 
 
    <xsl:template name="prewrap">
     <xsl:param name="text" select="."/>
     <xsl:variable name="spaceIndex" select="string-length(substring-before($text, '  '))"/>
     <xsl:variable name="tabIndex" select="string-length(substring-before($text, '&#x09;'))"/>
     <xsl:variable name="lineFeedIndex" select="string-length(substring-before($text, '&#xA;'))"/>
     <xsl:choose>
       <xsl:when test="$spaceIndex = 0 and $tabIndex = 0 and $lineFeedIndex = 0"><!-- no special characters left -->
           <xsl:value-of select="$text"/>
       </xsl:when>
       <xsl:when test="$spaceIndex > $tabIndex and $lineFeedIndex > $tabIndex"><!-- tab -->
         <xsl:value-of select="substring-before($text, '&#x09;')"/>
         <xsl:text disable-output-escaping="yes">&amp;nbsp;</xsl:text>
         <xsl:text disable-output-escaping="yes">&amp;nbsp;</xsl:text>
         <xsl:text disable-output-escaping="yes">&amp;nbsp;</xsl:text>
         <xsl:text disable-output-escaping="yes">&amp;nbsp;</xsl:text>
         <xsl:call-template name="prewrap">
           <xsl:with-param name="text" select="substring-after($text,'&#x09;')"/>
         </xsl:call-template>
       </xsl:when>
       <xsl:when test="$spaceIndex > $lineFeedIndex and $tabIndex > $lineFeedIndex"><!-- line feed -->
         <xsl:value-of select="substring-before($text, '&#xA;')"/>
         <br/>
         <xsl:call-template name="prewrap">
           <xsl:with-param name="text" select="substring-after($text,'&#xA;')"/>
         </xsl:call-template>
       </xsl:when>
       <xsl:when test="$lineFeedIndex > $spaceIndex and $tabIndex > $spaceIndex"><!-- two spaces -->
         <xsl:value-of select="substring-before($text, '  ')"/>
         <xsl:text disable-output-escaping="yes">&amp;nbsp;</xsl:text>
         <xsl:text disable-output-escaping="yes">&amp;nbsp;</xsl:text>
         <xsl:call-template name="prewrap">
           <xsl:with-param name="text" select="substring-after($text,'  ')"/>
         </xsl:call-template>
       </xsl:when>
       <xsl:otherwise><!-- should never happen -->
           <xsl:value-of select="$text"/>
       </xsl:otherwise>
     </xsl:choose>
    </xsl:template>

Tip: Java thread dumps on linux

2008-06-16T11:50:00.000-05:00

To get a thread dump in Java on linux run "pkill -3 java"

Ethical programming

2008-06-16T11:48:00.001-05:00

It should be noted that no ethically-trained software engineer would ever consent to write a DestroyBaghdad procedure. Basic professional ethics would instead require him to write a DestroyCity procedure, to which Baghdad could be given as a parameter.

-- Nathaniel Borenstein

(Passed on by Reid Nimz.)

Rename multiple files

2008-02-15T15:32:00.002-06:00

Options for renaming multiple files on Windows

Windows explorer: It only renames them to xxxx (y).ext where the only thing that varies is y (an incrementing number).
Various utilities available for download: I don't like to risk running some unknown program for something that seems so simple.
Command line for in do command. To prepend "3-" to every directory that starts with "60-" run: for /d %i in (60-*) do ren %i 3-%i

Geek Status

2008-02-11T14:00:00.000-06:00

In my IM client I set my status to the following. I admin that I'm a geek but it's fun!
echo "JANS" | sed "s/A//" | sed "s/J/Ava/" | sed "s/N/il/" | sed "s/S/able/"

3 paychecks in February

2008-02-04T10:18:00.000-06:00

I get paid bi-weekly on Fridays and this year I get 3 paychecks in February. I was wondering how often that happens and with Excel's help I found that it happens every 56 years. I also found that a month with 3 paychecks will be 5-7 months later than the last month with 3 paychecks. In 2010 there will be 3 months with 3 paychecks.

Explaing zero-based arrays

2008-01-29T10:55:00.000-06:00

Sometimes people have a hard time understand zero-based arrays but I just realized that ages are zero-based.

The first year of life someone is 0 years old.
The 2nd year of life someone is 1 year old.
Etc.

Genome assembler

2008-01-25T11:06:00.000-06:00

I have been listening to "The Genome War" and it seems like the the difficulty of assembling the pieces from the Shotgun sequencing isn't has hard as described in the book.

Data points:
Base pairs in the Human Genome: 3 billion.
Different types of base pairs: 4
Sequence length: 2,000
Maximum number of sequences per whole genome: 1,500,000
Number of reads to get coverage: 12
Total number of sequences to assemble: 18,000,000
Total ends to match: 36,000,000
Length of an end: 50 base pairs (13 bytes can store 52 base pairs)

Technique:
So if you made a database table with a column to store the end code (from the outside) and a sequence column to store the sequence that for that end, you would have 2 rows per sequence for a total of 36,000,000 rows. Each row would have 513 bytes of info for a total of 17 GB of data.
Then make a table called End48 with a Key48 column for 48 base pairs (12 bytes) and a Value52 for 52 base pairs (13 bytes).
Fill that table so that each end in the main table is put in the Value52 column and and the first 48 base pairs of that end are put in the Key48 column.
Continue stripping down the end base pairs into tables End44, End40, End36, ..., End8, End4. (You actually only have to go as far down as the DB can easily sort the key column -- I think current DBs wouldn't need any End tables).
Then you can start by sorting the key column of the smallest End table and continue until all of the sequences are sorted by their end pieces. Finally go through the sorted results and join any sequences that have the same end value. A lot of this processing could occur as the data comes in so you wouldn't have to wait until the end to do all of the computing.

This assumes that sequences always end at the same point which I am not sure is true. If that isn't true then you might end up with multiple copies of the genome in the final assembly stage but that would not be a problem.

That technique could be easily done with a few thousand dollars of hardware today and I assume it would not have taken a super-computer in 1999-2000.

So what am I missing because apparently the problem was much more difficult to solve?

Reference: http://en.wikipedia.org/wiki/Human_genome_project

What kind of programming work do you like best?

2008-01-22T07:47:00.000-06:00

When interviewing candidates I would ask them the following question:
What kind of programming work do you like best?

They always (3-4 interviews) gave then same answer: Creating new software.
Since that isn't the answer that I would give I asked my co-workers and between 4 of us we had 3 different answers:

Creating something new
Debugging problems.
Improving (adding features, improving performance, etc).

Would you give one of those answers? Do you have a different answer?

Zooming to better use desktop space

2008-01-02T12:57:00.000-06:00

On a real-life desktop I will often move toward an object to work with it. i.e. When I want to work with the calendar I will move closer to it. That allows better use of my desktop because some objects are "zoomed out" and therefore take less space (in my field of view).

Has anyone ever tried to incorporate a similar idea into a GUI. Icons, minimize/maximize, and resizing are somewhat like that but not quite enough. It would be nice to resize something to a "zoomed out size". i.e. I could set a size for my email program when it isn't in use and it would be shrunk to fit in that space when desired.

Telecommuting

2007-12-17T12:43:00.000-06:00

I telecommute one day per week and used to telecommute 2 days per week. I would like to telecommute more but my employer isn't very open to doing that (except short-term for a specific project). I don't know of any Java enterprise developers that do major telcommuting (4 days per week or more). I have also not seen very many telecommuting jobs for enterprise Java developers. Why don't more exist?

Technorati Profile

Subversion: Moving tags

2007-12-12T11:06:00.000-06:00

I wish Subversion had a better way of moving tags. The only way that I know to move a tag is to remove the file from the tag and then copy it again. Revision tree browsers don't seem to handle that very well. This also requires keeping the directory structure under the trunk and tag in sync.

Use case: We have thousands of "maps" and we want to tag which version of each map is the "production" version. We need to be able to easily get the production version of all maps.

Can anyone suggest a better way to address our use case?
I have considered properties also but then we can't get the prod version of all files easily. Merging to the tag doesn't appear to be very easy either.

IntelliJ default class javadoc comment

2007-11-26T11:20:00.001-06:00

Why does the default IntelliJ default class javadoc comment use non-standard syntax? Instead of creating a line with "User: jstauffer" it could create a line with "@author jstauffer". The other lines that it creates (Date and Time) probably don't have javadoc syntax to use but why not use the javadoc syntax when available?

For reference here is an example:

/**
 * Created by IntelliJ IDEA.
 * User: jstauffer
 * Date: Nov 13, 2007
 * Time: 11:15:10 AM
 * To change this template use File | Settings | File Templates.
 */

Naming abstract classes

2007-11-26T11:12:00.000-06:00

Normally I see abstract classes named as AbstractClass. But when there are many abstract classes that leads to needing to type at least AbstractC when using code completion. Therefore I suggest that abstract classes be named ClassAbstract so that code completion is more usable. "Abstract" is a modifier on the class name anyway and it doesn't need to be in the primary position. What do you think?

I know this isn't a huge deal -- I am just suggesting it as a minor improvement.

Defaults have consequences: Microsoft Word margins

2007-11-21T14:16:00.001-06:00

How much paper would be saved each year it Microsoft changed the default margins in Word to 1" on each side (or even 1/2")?

Autoboxing quiz

2007-10-19T20:18:00.000-05:00

Does widening or autoboxing happen first? Which param method will be called from the autoboxing method? If one param method is commented out then it will have no problem calling the other.

private static void autoboxing() {
    Integer integer = new Integer(2);
    param(integer);
}

private static void param(int param) {
    System.out.println("param(int " + param + ")");
}

private static void param(Object param) {
    System.out.println("param(Object " + param + ")");
}

Website idea

2007-10-18T11:20:00.000-05:00

If you make your fortune with this idea, send me a few bucks.
Make a website where the user can keep a list of things that they need/want to buy.
Allow easy management of that list (through web, WAP, SMS, etc).

Then....
Work with stores so they the user can get a list of all of the items in the list that the given store has. The store could even allow printing the list from a kiosk in the store (registry computers) and would include the location, price, etc. The stores would benefit because people would probably buy more if they remembered what they wanted to buy and they would buy items that they didn't know the given store had. You could then charge the store a small fee so that you wouldn't need ads on the website or user fees.

For stores that don't support that use GPS to determine the store and try to send a list of items that the store has (scrape website?).

Does a website like this exist?

Haiku

2007-10-17T11:05:00.001-05:00

One connection good.
Then two connections better.
Or maybe not so.

Form post with URL paramters (after question mark)

2007-10-09T13:49:00.000-05:00

I had a URL that I wanted to POST with JavaScript so a made a


        <form name="doForm" action="" method="post">
        </form>

and used JavaScript to set the action and call submit. But Tomcat showed the request as a GET. I found that adding a dummy form input fixed the problem:


        <form name="doForm" action="" method="post">
            <input type="hidden" name="blah" value="blah"/><!-- need at least 1 input or the form uses method="get" even when "post" is specified. -->
        </form>

Exception plan

2007-10-09T13:47:00.001-05:00

In projects on which I have worked I find that a few common Exceptions are used over and over again and tend to lose their meaning. Does anyone have good resources for exception patterns?

Subversion notes

2007-10-04T10:44:00.000-05:00

We recently converted from cvs to Subversion and overall I like it much better than cvs but:

I wish cvs2svn converted .cvsignore files to svn:ignore properties.
I wish it handled tags and branches natively instead of using the copy method. Tags and branches are core parts of version control and I think something is lost by implementing them non-natively.
I hope svn:externals will be able to point to a specific file soon.
I wish update and status didn't print so much extra info about the externals. For status I have to run svn status --ignore-externals --show-updates %* | grep -v "^[XI]" | grep -v "^Status against revision" just to get what I want.

Converting .cvsignore file to Subversion svn:ignore property

2007-10-02T07:37:00.000-05:00

If you have converted a cvs repository to a Subversion repository and need to convert .cvsignore files to subversion svn:ignore properties then the following script should be useful to you. Note that it probably doesn't handle spaces in filenames.

#!/bin/bash

find . -name ".cvsignore" -print | sed "s/\/.cvsignore//" | tee ignoredirs.txt

for i in `cat ignoredirs.txt`
do
    echo Processing $i/.cvsignore
    svn propset svn:ignore -F "$i/.cvsignore" "$i"
    svn remove "$i/.cvsignore"

done

Garbage collecting file system

2007-09-28T09:10:00.000-05:00

Why don't current file systems implement garbage collection so that deleting a directory takes constant time (regardless of how many descendants it has)?

Google has done that See section 4.4 (page 8) of http://209.85.163.132/papers/gfs-sosp2003.pdf

Subversion: Setting svn:keywords property

2007-09-28T07:20:00.000-05:00

If you converted from cvs and need to set the svn:keywords property you can use the following script (doesn't handle spaces). I wrote this before I realized that cvs2svn already set the property and I therefore didn't need it.


#!/bin/bash

echo Seaching...
# Put Keywords up one directory so the 2nd-last greps don't search it.
grep -R -H "\$Date:" * | grep "\$Date:" > ../Keywords.txt
grep -R -H "\$Revision:" * | grep "\$Revision:" >> ../Keywords.txt
grep -R -H "\$Author:" * | grep "\$Author:" >> ../Keywords.txt
grep -R -H "\$Id:" * | grep "\$Id:" >> ../Keywords.txt

echo Setting Properties...
cat ../Keywords.txt | sed "s/:.*$//" | sed "s/^/\"/" | sed "s/$/\"/" | xargs -L 1 svn propset svn:keywords "Date Revision Author Id"
echo Results:
svn status

Remove empty Subversion directories

2007-09-25T12:52:00.000-05:00

I couldn't find any scripts that would prune empty Subversion controlled directories so I wrote the following. Enjoy!


#!/usr/bin/bash

for i in `find . -type d -print -name ".svn" | grep -v "/\.svn"`
do
    if [ -z "`ls -A $i | grep -v '\.svn' `" ]
    then
        echo Removing $i
        ls -A $i
        svn remove $i
    fi
done
echo Results:
svn status

Update:
The script above doesn't handle spaces in the filename so use the following two scripts if you have spaces in any filename:


svnPrune.sh
#!/bin/bash

echo Searching...
find . -type d ! -path "*\.svn*" ! -name "\." ! -name "tags" ! -name "branches" -exec /svn/svnPruneDirectory.sh {} \;

echo Results:
svn status

svnPruneDirectory.sh
#!/bin/bash
directory="$*"
#echo Processing $directory ------------------------------------------------------

files=`ls -A "$directory" | grep -v '\.svn'`
#echo files=$files
childrenCount=`ls -A "$directory" | grep -v '\.svn' | wc -l`
#echo $directory: $childrenCount
if [ "$childrenCount" -eq "0" ]
then
    echo Removing $directory
#    echo $files
    svn remove "$directory"
fi

Terminal window with 3 frames

2007-09-24T11:32:00.000-05:00

I think it would be useful to have a terminal window with 3 frames.

Output frame (At the top): Shows all program ouput and input/commands that the have been processed.
Input frame (in the middle): Allows the user to enter standard input. Only show when a program is waiting for standard input.
Command frame (at the bottom): Allows the user to enter commands.

Benefits:

It would be obvious when I wrote a command that is waiting for user input.
It could allow you to provide standard input via a command after running another command.

This could probably also be done in one frame with coloring to show the different parts. The prompt would change color when waiting for standard input (as opposed to waiting for the process to finish).

What do you think? Does something like this exist?

Java applet to check Java version

2007-09-07T14:57:00.000-05:00

Out product only requires Java 1.4 (or higher) but we want to require Java 1.5. About 10% of applet requests used Java 1.4 so we want a way to notify the users who use Java 1.4 that they should upgrade. Searching with Google I couldn't find any such applet so here is my version.

JavaVersionCheck.class:

import javax.swing.*;

/**
* Prints the <code>message</code> if the java version doesn't match
* <code>javaVersionPattern</code>.
* @author James Stauffer
*/
public class JavaVersionCheck extends JApplet {
   public void init() {
       try {
           String javaVersionPattern = getParameter("javaVersionPattern");
           String message = getParameter("message");
           if(VersionMatches(javaVersionPattern)) {
               add(new JLabel(message));
           }
       } catch (Exception e) {
           e.printStackTrace();
       }
   }

   public static boolean VersionMatches(String javaVersionPattern) {
       String javaVersion = System.getProperty("java.version");
       return javaVersion.matches(javaVersionPattern);
   }

   public static void main(String args[]) {
       if(args.length > 0) {
           String javaVersionPattern = args[0];
           if(VersionMatches(javaVersionPattern)) {
               if(args.length > 1) {
                   System.out.println(args[1]);
               } else {
                   System.out.println("Matches " + javaVersionPattern);
               }
           }
       }
   }
}

HTML:


<applet height="30" width="300" code="JavaVersionCheck.class">
   <param name="javaVersionPattern" value="^1\.4.*">
   <param name="message" value="Java 1.4 is not supported.  Please upgrade to 1.5.">
</applet>

toString() cost

2007-08-10T10:41:00.001-05:00

Do you assume that toString() on any given object has a low cost? I do. Is that assumption valid? If it has a high cost should that normally be changed? What are valid reasons to make a toString() method with a high cost?

Dynamic/static language

2007-08-02T10:43:00.000-05:00

What if a language allow both static and dynamic types. That might allow the best of both worlds. i.e.:
String str = "Hello";
var temp = str;
temp = 10;

1. Would that be possible?
2. Would that be beneficial?

Debugger for *nix pipe commands

2007-06-27T11:33:00.000-05:00

As I build *nix piped commands I find that I want to see the output of one stage to verify correctness before building the next stage but I don't want to re-run each stage. Does anyone know of a program that will help with that? It would keep the output of the last stage automatically to use for any new stages. I usually do this by sending the result of each command to a temporary file but it would be nice for a program to handle this.

10 things to do today

2007-06-25T13:26:00.000-05:00

Here is my list of 10 things to do today:

Code
Goto #1

Programming Trends

2007-05-22T16:16:00.000-05:00

Java vs. other languanges
http://www.google.com/trends?q=Java+-indonesia%2C+PHP%2C+C%23%2C+ruby%2C+perl&ctab=0&geo=all&date=all&sort=0

Java versions:
http://www.google.com/trends?q=Java+1.2%2C+Java+1.3%2C+Java+1.4%2C+Java+1.5%2C+Java+1.6%2C+Java+1.1&ctab=0&geo=all&date=all&sort=4

Telecommuting tips

2007-05-18T13:59:00.000-05:00

I have been telecommutting 1-2 days/week for a few years so I present the following tips to those who want to telecommute:

Practice communicating by email (especially when it is easier to talk in person about something) so you get better at writing emails that are complete and easy to understand.
Practice doing as many normal activities on your telecommuting days as possible. Minimize "waiting until you get back to the office".
Practice minimizing differences between your telecommuting and in-office days so that your telecommuting doesn't negatively affect the company.

For me #1 was the hardest to learn.

Method return values for null objects

2007-05-07T13:51:00.000-05:00

Would it be useful to be able to provide method return value for null objects?
For a List the null return values might be:
get(int) : null
size() : 0
iterator() would be an empty iterator

That would allow the following code that has less null checks.

List items = null;

if(something) {
items = ...
}

for(int index = 0; index < items.size(); index++) {
Object obj = items.get(index);
}

Automatic casts

2007-03-30T09:10:00.000-05:00

Why can't the compiler automatically insert casts?
List list = new ArrayList();
list.add("one");
list.add("two");
for(Iterator i = list.iterator(); i.hasNext(); ) {
String item = i.next();//Automatic casts
System.out.println(item);
}
//Or using the new for construct:
for(String item : list) {
System.out.println(item);
}

http://weblogs.java.net/blog/emcmanus/archive/2007/03/getting_rid_of.html shows that the compiler can get really close. Why can't it go the rest of the way?

IDE freedom

2007-03-16T09:50:00.000-05:00

One way that I evaluate a new IDE is by opening a file in a fresh install and determining how much I can do with that file. Obivously features that need to know about the other files in the project won't work. I recently tried to use NetBeans and JDeveloper to generate getters and setters. Neither would allow me to do that and one of them allowed me to choose that menu item but it just did nothing at all. Maybe creating a project would have helped but that should be needless. When an IDE "gets in the way" with what I want to do like that then it feels more like a straightjacket than a tool. I know that is a simplistic evaluation but when that test fails I wonder how constraining the rest of the IDE is.
Do you think that is a fair way to evaluate?

Cygwin ssh and key files

2007-02-23T15:02:00.000-06:00

I tried to use key files with Cygwin ssh (so I don't have to provide my password each time) but kept running into the following error:

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@         WARNING: UNPROTECTED PRIVATE KEY FILE!          @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
Permissions 0644 for '//turfclub/users/jstauffe/.ssh/id_rsa' are too open.
It is recommended that your private key files are NOT accessible by others.
This private key will be ignored.
bad permissions: ignore key: //turfclub/users/jstauffe/.ssh/id_rsa

The problem is that chmod wouldn't actually change the permissions so I couldn't get past this problem. When I searched on this I found refernces to turning StrictMode off but that didn't work for me can caused errors.

To fix this I did the following:

Started my bash shell
mkdir /home
mkdir /home/.ssh
cp ~/.ssh/* /home/.ssh
chmod 600 /home/.ssh/*
mv ~/.ssh ~/.ssh.bak
cd ~
ln -s /home/.ssh

It now works great (even in the normal Windows shell)!

Automatic casting

2007-01-17T14:48:00.000-06:00

Is there any downside or problem potential to change the Java compiler to automatically cast? In the example below the result of list.get(0) would automatically be casted to the type of the variable hi.


List list = new ArrayList();
list.add("hi");
String hi = list.get(0);

I know that generics allow you to reduce casting but they do so at the expense of making declaration more difficult. To me, the benefit of generics is that they allow you to have the complier enforce more rules -- not they they reduce casting (but I haven't used them much so I am somewhat uninformed). This proposal would only reduce the amount of code to type, not move it to another place.

Who has changed the most lines in cvs?

2007-01-16T20:00:00.000-06:00

The following was done on a Windows machine with UnxUtils.


cvs annotate > annotate.txt
rem remove the portion before the name
sed "s/^[0-9. (]*//" annotate.txt > annotate2.txt
rem remove the portion after the name
sed "s/[ ].*$//" annotate2.txt > annotate3.txt
sort annotate3.txt > annotate4.txt
uniq -c annotate4.txt > annotate5.txt

Tip: Need to communicate between anonymous inner classes?

2007-01-15T09:08:00.000-06:00

Here is a quick tip:
Do you have two anonymous inner classes that need to communicate? I had two anonymous inner classes that implemented Runnable and needed to communicate with a boolean value. Therefore I decided to make a boolean variable in the declaring method but in order for the inner class to access the variable it needs to be declared final. But that would prevent me from changing the variable! I needed a mutable Boolean. Instead of creating a MutableBoolean class I declared the variable as "final boolean[] done = new boolean[]{false};" so that one thread could call "done[0] = true;" and the other thread could check "if(!done[0])". If there is a better pattern for this please tell me.

Background of why I needed this:
In an applet, I was saving data back to the server. In order to keep the UI responsive I of course do that in a separate Thread from the Event Distpatch Thread. When I save the data I first send then data and then read the response so the user only really needs to wait for the data to be sent. Therefore I have a timer that tells the user that they don't need to continue waiting after they have waited 30 seconds. But I don't need to pop that if the response is already read so I needed a way for the reader thread to tell the timer message Runnable that it was already done. I actually found a better solution: The reader thread can call stop on the Timer so that it is never run.

Google Desktop had to be removed

2006-11-21T11:13:00.000-06:00

Since my last post on Google Desktop I had 3 problems with it:

Paused indexing prevents rename of directories
Google Desktop appears to hang computer then using Remote Desktop (Terminal services)
IT required that I remove it because of security issues.

:-(

Search and replace across files

2006-11-02T12:01:00.000-06:00

Some of my co-workers had their cvs login name changed so we had the problem where every directory checked out from cvs had a CVS subdirectory with a Root file in it that had the old username. The easy way was to delete all checkouts and checkout again but if that would cause the loss of data we needed a different solution.

I handled my machine by doing a Windows search for all Root files, adding them to a new project in Source Insight, then doing a search and replace but others don't have nice editors like that. My machine had over 10,000 Root files so manual processes were out of the question.

For those without a nice editor that can do a replace across files I came up with the following solution:

Install UnxUtils and add the main directory to the path.
Run:
find . -name Root -print | sed "s/.*/copy & &.new \&\& sed \"s\/jstauffer\/jstauffe\/\" &.new > & \&\&amp;amp;amp; del &.new/" > Root.bat
Windows has find so I had to make sure that it used the correct find. Basically it finds all Root files, creates a command to copy that file, use sed to do the replace back to the original file, and delete the copy of the file.
Run Root.bat

I know the same could have been achieved in Perl or even Java but is there anything else that would be as quick and easy (granted it isn't easy to understand)?

Dragging in UI and finishing with a quick movement

2006-10-17T10:18:00.000-05:00

When the user drags an item to a location, slows movement, and then makes a quick movement right before finishing the drag, the user probably wanted the ending location to be the mouse location right before the quick movement. The user should be prompted for which target they want if the quick movement changed the target. With normal mice there probably isn't often a quick movement but I use a pen (an old version of the Intuos 6x8) for ergonomic reasons and I often have a quick movement as I let go of the button on the pen.

Google Desktop Rocks!

2006-10-06T11:03:00.000-05:00

I was developing a new feature and needed to add a new column to the database. I didn't remember the exact syntax so I went to look for a sample on my computer. A few weeks ago I had installed Google Desktop (because I had done some searching using Windows search that took an hour!) so I thought I would give that a try. I knew the command started with alter table so I first typed that into the search. In less than a second it gave 6 results but the first result wasn't useful. So I added quotes around the search words and an instant later it showed 6 results and the first result was exactly what I wanted! I was quite surprised by how fast and easy that was! I even had to show it to my co-worker LaMoine.
Just for comparison we went through the steps of doing it the old way. I knew there was probably an example in a specific directory (5 levels deep) so I clicked on the button for Windows Explorer in the task bar and did 5 clicks to get to that directory. I then did a search for the same term (without the quotes) and it gave the same file as the first result.
It took over 25 seconds compared to under 10 seconds for Google Desktop! That savings in time would be significant in keeping me "in the zone" except that I was so surprised by how good it was that I had to show LaMoine and write this blog entry. Anyway the next time I have to search for something on my computer (when not in an editor) I will be using Google Desktop! (I have no ties to Google -- I am just a satisfied customer).

Why I like my job

2006-09-08T11:02:00.000-05:00

Here are a few reasons (off of the top of my head) why I like my job:

Telecommuting one day per week (I wish I could do that more.)
Being a "guru" on a product.
Good team that is smart and willing to do any task to help.
Good compensation
5 weeks of vacation
Minimal office politics
The company is profitable and growing quickly
The company is the biggest company in our area (or so they tell us :-) ).
We use a language that I like (Java if you couldn't guess :-) )
We use 3rd party libraries where appropriate.
Few meetings and very few useless meetings
We attempt to use best practices and improve things as much as possible while still balancing business needs (like creating new features for users).

For reference my title is Sr. Software Engineer and the products on which I work are web-based using J2EE.

My employer: "SPS Commerce is the leader in hosted Electronic Data Interchange (EDI) software. We offer a rapid, turn-key service to connect suppliers with their retail and distributor customers using tested and proven EDI connections and integration services."

I like my job so well that pretty much the only reason that I would be willing to switch would be if I could telecommute more and still have most of the things above.

What do you like about your job and what would it take for you to move to another job? The harder it be for another company to lure you the better you probably like your job!

How do you make money with open-source software?

2006-08-30T11:58:00.000-05:00

You don't, you save money!

(Some companies do make money but many more companies could save money). More companies are concerned with using software than selling software. If users of software fund the open-source development of software then it will make economic sense for the software to be developed open-source.
If 50% of companies that buy commerical database systems instead used an open-source database and spent 25% of the savings promoting and advancing that open-source database then it would all work out well.
The one difficulty is getting the software customers organized to do this. It really helps if someone can jump start the project so that other companies can see the value.

Would you rather spend $100 for for Windows XP or get Ubuntu and spend $25 supporting it?

Definitions: Always and Never

2006-07-25T07:41:00.000-05:00

Definitions:

Always – At least 10% of the time.

Never – Less than 90% of the time.

Iterating

2006-04-07T14:42:00.000-05:00

I often see code like:

Iterator i = list.iterator();
while(i.hasNext()) {
    ...
}

but I write that (when Java 1.5 isn't available) as:

for(Iterator i = list.iterator();i.hasNext();) {
    ...
}

because

It shorter
It keeps i in a smaller scope
It reduces the chance of confusion. (Is i used outside the while? Where is i declared?)

I think code should be as simple to understand as possible so that I only have to make complex code to do complex things. What do you think? Which is better?

Sorting algorithms

2006-03-09T13:13:00.000-06:00

http://www.cs.rit.edu/~atk/Java/Sorting/sorting.html shows four sorting algorithms and animations for each. It shows Bubble, Quick, Odd-Even Transposition, and Shear sorts. The last two are multi-processor sorts so I have 2 questions:

Could Bubble and Quick sort be changed to multi-processor sorts? It seems that Quick Sort could be.

How would they compare in time to the other multi-processor sorts? It would be especially interesting how Quick Sort would compare.

Don't return in a finally clause

2006-03-01T10:34:00.000-06:00

The code below actually prints "yikes!"
If you return in a finally block then any Throwables that aren't caught (in a catch block that is part of the same try statement as the finally block) will be completely lost. The really bad part about this is that it looks so innocent. I can think of no reason to return in a finally clause. If nothing else, catch Throwable and return in that so it is obvious what is happening. Note this also applies to other things that transfer control (continue, throw, etc).


public class Test {

  public static void main(String[] args) {
    try {
      doSomething();
      System.out.println("yikes! don't program like this!");
    } catch (RuntimeException e) {
      System.out.println("got it.");
    }
  }
  
  public static void doSomething() {
    try {
      //Normally you would have code that doesn't explicitly appear 
      //to throw exceptions so it would be harder to see the problem.
      throw new RuntimeException();
    } finally {
      return;
    }
  }
}

Strong vs. weak typing

2005-11-07T07:34:00.000-06:00

I like strong typing but don't like weak typing because I would rather that the compiler find my bugs. A point in the middle is type inference.

http://beust.com/weblog/archives/000333.html

A co-worker pointed out that some languages allow a variable to be declared as strong or weak and that sounds like it would be the best of both worlds.

Synergy: Share keyboard and mouse between computers

2005-10-31T12:15:00.000-06:00

I just learned about Synergy which is a software KVM (without the "V") and it looks pretty slick.

http://synergy2.sourceforge.net/about.html

Good programmer vs. knowing a programming language

2005-10-27T14:49:00.000-05:00

From http://weblogs.java.net/blog/flozano/archive/2005/10/what_makes_prog.html

It's just like giving a good programmer a course of drawing software. He may learn all about using the software, but he won't be able to create nice, pleasant figures. You need a different skill set to create graphics than to create software.

Declaring variables

2005-10-05T09:38:00.000-05:00

A pet peeve of mine is when a variable is declared way before it is needed. It is much easier to understand a piece of code if a variable is declared just before it is needed. That immediately tells me that it isn't used anywhere before that or in any wider scope.

I also find it annoying when a variable is declared with a null value and them immediately assigned a value.

String value = null;
value = "hi";

should be:
String value = "hi";

Not that one reason to do that the first way is if the second way would create a line that is too long.

IncompatibleClassChangeError

2005-08-18T17:17:00.000-05:00

I just delivered a patch to SQA and got a IncompatibleClassChangeError. The javadoc description doesn't help much.

Thrown when an incompatible class change has occurred to some class definition. The definition of some class, on which the currently executing method depends, has since changed.

I looked at the line of code that had the error and went on a hunch. In my case a class used a variable in a super-class and I had changed that variable from static to instance. Therefore the class file in the patch was trying to access it as an instance variable but the old super-class still had it as a static variable. I changed the patch class to not use that variable and sent it back to SQA. Hopefully that fixes it.

Finding the file for a class

2005-08-12T07:51:00.000-05:00

From http://java.sys-con.com/read/117751_2.htm

Classpath Problems
Another class of problems are classpath issues. There are times when you are not sure if there is another version of a class in the classpath that is getting picked up before yours, usually a result of a bad environment setup. To eliminate this possibility, a simple check is to add a print statement to see if your new code gets picked up. If it isn't getting picked up, you need to locate the other class that is getting picked up. One neat API in Java that allows you to locate where a class is being picked up is:

Class.getProtectionDomain().getCodeSource().getLocation()

In most cases, depending on the class loader being used, you'll get the location of the class that is being executed and you can correct your environment setup.

"Java" article?

2005-07-26T07:56:00.000-05:00

Does this article/press release make any sense for a "Java" magazine?
http://java.sys-con.com/read/112734.htm

GUI designers take note: Selecting by first letter should show as many as possible that start with that letter

2005-05-20T11:39:00.000-05:00

When I am in a list and I press a letter to jump to the first entry that starts with that letter why does it leave that entry on the bottom of the visible entries? It should make the entry the top visable entry so that many entries that start with that letter can be seen.

In more concrete terms if I am selecting a state from a drop-down list and press "w" it should make "Washington" visible at the top instead of the bottom so that I can see Wisconsin without scrolling.

This is just my little pet peeve of the day. :-)

Sometimes old solutions work best

2005-05-20T10:53:00.000-05:00

I have a 4.8 MB file where I needed to do a replace that would happen about 850,000 times. I tried it in a few different editors:

Notepad: It looked like it was taking 3 seconds per replace so I killed that. I don't have the time to wait a month!
Source Insight (My preferred code editor): It partially suceeded in a few minutes but it ended up corrupting the output since it "ran out of undo space". Time to ask my co-workers...
jEdit: After running for at least 15 minutes I killed it.
TextPad: After running for at least 10 minutes I killed it.
sed: 10 seconds!

BTW my machine is a hyperthreaded P4 3.06 GHz with 1 GB of RAM with a serial HD.

Case of static method names

2005-04-19T08:10:00.000-05:00

I like to make my static method names start with an upper case letter. I know that isn't standard and that only class names are supposed to start with an upper case letter but I find that it is helpful because it quickly shows which methods are static. Also, I have never confused a static method with a class because the usage is different. Does this sound beneficial?

(I don't know from where I got this idea but at one time I assumed it was a standard.)

Developer Documentation

2005-04-08T14:35:00.000-05:00

Have you ever gotten a product and you could obviously tell that the person who wrote the manual didn't speak English natively?
From my little knowledge of languages it seems that it works better for people to translate into their native language.

I think the same principles applies to developers translating from code to documentation. I would prefer to explain how a product works to a user and have the user write the documentation because they will cover things that seem obvious to me but not the average user.
Someone not intimately familiar with the product will probably write much better documentation.

Finding duplicate code

2005-04-08T12:39:00.000-05:00

I noticed some duplicate code in a program that I help maintain and thought "wouldn't it be nice to have a tool that found duplicate lines of code?"
After a quick chat with a co-worker we decided that we could make something that read in every source line, trimmed it, created a hash and added that hash to a List for that file. Also add that hash to a Map with a List of all of the files and lines where that hash occurs. When all files are read go through all lines with the same hash (from the Map) and look at the next lines to find if those hashes match. It wasn't a perfect design but it would probably work well enough.
Before I went any further I decided to check Google and low and behold I found PMD http://pmd.sourceforge.net/cpd.html. It is on its 3rd algorithm and "now it can process the JDK 1.4 java.* packages in about 4 seconds" and "works with Java, C, C++, and PHP code." I guess there isn't much point in writing my own version. :-) Remember to always do a quick search before coding something new.

Anonymous class constructor

2005-04-06T14:29:00.000-05:00

Today I was trying to modify an anonymous class to add a parameter to the constructor. After talking to 3 other co-workers we couldn't decide if it was possible because a constructor has to be named to match the name of the class and an anonymous class does not have a name. I found the answer at http://www.developer.com/java/other/article.php/3300881 under the section titled "Anonymous classes versus local classes." I am not including the answer here so that you can think about it for a while if you desire.

Extra info in stack traces

2005-04-05T08:47:00.000-05:00

I often find that when I see a stack trace I want to know the value of some variables in that stack. I created a request for enhancement (http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4857236).
Does that seem useful to you?

What was null?

2005-04-05T07:38:00.000-05:00

When I get a NullPointerException I usually have to look at the source code to determine what might have been null. Therefore I created a feature request (http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4834738) to request that NullPointerExceptions include the name of the variable when possible. Do you think that would be useful?

del.icio.us Bookmarks

2005-04-01T15:09:00.000-06:00

I have added most of my computer and programming related bookmarks to http://del.icio.us/Stauffer

How not to use JDBC

2005-03-30T19:09:00.000-06:00

This bad example came from production code. :-) (DatabaseManager is a wrapper for JDBC and behaves similarly.)


String select = "select ...";
Result r = null;
List numberList = new ArrayList();
try {
  r = DatabaseManager.ExecuteQuery(select);
  while (r != null) {
      r.next();
      numberList.add(r.getString("col"));
  }
}
catch (Exception e) {
  Result.Close(r);//Closes the result while handling null and any IOException.
}

A few of the problems with this code:

DatabaseManager.ExecuteQuery can never return null (but I can let that slide some since a programmer would have to look at the code to know that -- or look at the other 64 examples in code to see that no other code checks for a null return value).
while(r != null): Knowing nothing about JDBC it should be obvious that r could never change from not null to null.
while(r.next()) is the standard way to use JDBC.
This code uses an Exception to get out of the while loop! (Note that I have done something like that once but there was at least a somewhat good reason and it was documented.)
The result should always be closed in a finally block.

So here is the improved code:


String select = "select ...";
Result r = null;
List trackingNumberList = new ArrayList();
try {
  r = DatabaseManager.ExecuteQuery(select);
  while (r.next()) {
      trackingNumberList.add(r.getString("col"));
  }
} catch (Exception e) {
  e.printStackTrace();
  //Logging would be nice but a stack trace to standard error is better than nothing.
} finally {
  Result.Close(r);
}