Replacing the Review Event (001)

[see blog entry 7/7/11 regarding intentional font issues in this post]

I sat through several Technical Review Boards (TRB) recently. After approximately 3 hours of review, each degraded into a session of writing the documents rather than reviewing them. None were of a quality suitable for publication. Several documents were unavailable beyond a prominent “draft� notice. What’s going on in our profession of Test & Evaluation engineering?

Two concomitant events give me a clue. First, I read a report published in the June 2004 issue of Control Engineering stating in a survey on computing practices of new engineers, that MathCAD and Matlab are used “much more heavily in academia than in industry.� The editor pondered why.

In the latest TRB, a 4:30pm discussion devolved into an analysis of why the author should list data products beyond an average and standard deviation. The author’s contention was that the minimum is promised, but for the actual test report, he would generate appropriate additional graphs or charts based on the content of the data.

Considering these issues in close proximity to each other made me realize it’s an issue of professional curiosity vs. business sense. A student uses Matlab or MathCAD because either program is an excellent experimentation environment – they are mathematical tools for searching and documenting invasive understanding after significant trial and error. In contrast, business communication is almost entirely defensive communication to others advocating or justifying a claim. Technical profoundness never sells a proposal or justifies a budget. So people who once spent hours pouring over Matlab now realize success with a half dozen bullet lists in a PowerPoint brief.

In college, it was an exercise in studying the tool and the world. In the business/ government/ industrial world, it’s an exercise in using the tool efficiently and getting onto the next concern.

In the case of the recent test plan that was on my mind, the author wanted to preserve the freedom to experiment with data and determine the best data products in context. This free intellectual pursuit is desired by two groups of people, at opposite extremes of the experience:

1) Increasingly, acquisition programs host a number of Ph.D.-type personalities that desire to minimally commit to test procedures because they want to experiment with integrated hardware until it’s optimized. They desire experimental data, not test data. Conflicts result when the government wants constrained tests, and a TSPR (Total System Performance Contract) contractor wants freedom.

2) The matrixed engineer who doesn’t understand subtle end-game negotiation of a contract sees the data product section of a test plan as a constraining straight jacket. The only escape is to document as little as possible, and learn/respond as the data rolls in.

If it’s an incomplete document, a review board should give it 3 hours, and go home. Instead, we destroy until the author is beaten. If it was an experienced person, they go to a different program. If it was a new person, we’ve killed one of our own and demotivated them from a career.

If the only person who succeeds in this environment is the un-curious, middle-of-the-road performer, we have a situation that is broke. What can be different?

  • Desire Peer Review
  • Be nice
  • Hire the right kind of person
  • Respect Other’s Time
  • Version control
  • Turn times on reviews (duration and deadline)
  • Do not look to justify your job at another’s meeting
  • Reviews must have a scope and granularity appropriate for the presented document. A draft does not get a detailed release.
  • Replace Event-driven TRB & SRB processes.

Perhaps Web-based logging or Wiki technology can help:

  • Public visibility (allowed peers)
  • Documented cross-referenced comments (not just email round table with death by attachments) – forces intellectually original contribution.
  • Standard database archive and search environment (MySQL or SQL Server).
Posted in General | Leave a comment

Batch Processed Individuals (015)

John C. Reece was the IRS CIO from March 2001 to April 2003. In the July 18th issue of Federal Computer Week, he proposed a tax system implemented as a Web-based solution that would collect federal taxes in much the same manner that sales taxes are collected – that is, as part of each transaction in which federal income taxes are payable. Collection transactions are posted to my record, and I just have to log in once a year, update info, and “balance the checkbook”, sort of speak.

Optimization

This is representative of a larger trend I’ve observed that bothers me. I first saw it at the United States Post Office, where I used to be able to ask what the fee schedule is for mailing things under different categories. I ask this information because it’s the immediate cause and necessary information for me to make a smart decision about my action, specifically how I’ll ship a package.

Times have changed. The methods, rules, or algorithms that define shipping services, return receipts, insurance, registration, and delivery times are no longer available. Instead, the textbook answer is “bring me the package, I’ll put it on the scale, and tell you your options.”

Sadly, this methods serve you, not me. Once the package is on the scale, your computer defines your options to accept the package. But you’ve deprived me of information to analyze my options. Your methods work if I’ve already committed to shipping with you. But maybe I want to go with UPS. In which case, USPS requires brown wrapping over marked boxes, and no strings. UPS refuses packages wrapped in brown paper, but will accept tie wrapped items. UPS gives $100 insurance free. USPS doesn’t. And so on.

I want to optimize my decisions before I commit. Because you no longer release algorithms and relationship information, I can’t. You insist on processing me as a serial stream of events – batch processed, with no mid-stream corrections.

Reading Mr. Reece’s article made me realize this is an even more potent and onerous change in the realm of federal taxation. In a manner similar to the UPS interaction, the user is deprived of any comparative analysis. “Tell us who you are, and your situation, and we’ll tell you the required tax.” This is NOT enough for my decisions of how to live a life! You have satisfied your agency needs, but deprived me of an important aspect of what the traditional partnership has been. I need to know how you do it, so I can optimize my choices to optimize what I value (in this case, it’s how much money I have to give up).

In fact, the depth of importance of knowing the algorithms is witnessed to by the fact that a normal person spends hundreds of dollars on tax filing services, let alone anybody considering estate or retirement planning. BIG dollars are spent customizing (more specifically, numerically optimizing) each person’s interaction with the IRS because they value the outcome. If you deprive people of their valued outcome, the method, by definition, is a failure.

Even with web-based IRS accounts for each individual, I’m sure somewhere in the National record, a person will still be able to extract a description of how the taxes are calculated, but this will NOT be lucid.

For example, the FASFA form is a step by step IRS-like form. But nowhere will you find the core truth that, once past the low-income deductibles, expected family college contribution is 5.6% (check) of any savings and investments, and a full 48% of any income cash flow. Balance this with a combined marginal federal, state, city, social security, Medicare, and sales taxation of over 50%, and you’ll see why families hurt with kids in college. Loans are inevitable. But the batch processed forms and web-field entry calculators don’t reveal this without dedicated and knowledgeable analysis. I’ll guarantee you most college administrator have never realized the content of this paragraph.

Errors

Even if you do have the intrepid character to tear into all the foundational regulations and laws (or finances to hire someone else to do it), here is a scary societal issue: when they differ, the batch processing web page will be taken as truth. What it says is “how much you owe”, regardless of what the original regulations say.

Don’t believe me?

I was in this type of trap in the realm of estate gifts to minors. There is a concept of “future interest” that is well defined in the tax laws, but somewhere it got misread, and propagated through the financial industry.

I was in this type of trap in the realm of comm-out procedures for military pilots who have been given a heading to fly by the ground-based air traffic controllers. An initial mis-reading was promulgated through years of publication of the Flight Information Handbook used by USAF pilot training.

I was in this type of trap with the USAF Reserve payroll system, when they blurred the distinction between “commuting areas” and “local areas”.

In all cases, it took months of effort to reconcile the executing arm of the supposed rule with the original source. With the finance issue, it took written correspondence with three IRS auditors (Three because what any employee says means nothing legally, so I figured if I got the same answer 3 independent times, chances were good it was right), and the legal department of a national investment firm. With the pilot issue, it took multiple letters to the military publications office, highlighting the FAA regulations that were misunderstood. With the pay issue I had to escalate the issue to the office of the commander at both the Reserve personnel center and the local base I was stationed at before the change was made.

The point is that once the batch process is entrenched, it becomes the truth. You have to dive very deep into a political environment of personalities, job responsibilities, and organizational relationships to ever re-connect people to the real truth. And in the process, it’s your butt on the line, your finances, and your life that is spent fixing the situation.

Implications

    Historical Identity

Your identity is the database record. Ask someone who’s been through an identify theft experience what it takes to prove you’re someone other than what the computers say you are. My observation is that you are allowed or defined to exist by existence of a birth certificate. You prove identity as an American by virtue of the same paper, or perhaps an alternate such as naturalization forms. In either case, these prove that you exist as part of the United States. A second part of your identity, how you exist, consists of all that you have been. Past tense is important here. Whether it’s a signature on a credit card or biometric security access via retina scanning, all the technology is in place to connect the flesh and bones at a given location and time to a known history previously exhibited by that same flesh and bones. Most pointedly, it does nothing to establish who you are. It establishes who you have been.

A socially visible example are the web-published sex offender data bases. Based on the concept of forgiveness, I could make a could make a case that there are times to “forget” the past. The Bible clearly says that God, at times, “does not remember” historical sins. Yet when the computer databases own the truth, and they analyze only history, you are who you have ever been.

In a technical sense, the technology used to implement the sex offender data bases prevented some reverse lookup capability that should have prevented vigilante behavior or loss of local real-estate values. That was before another entrepreneur bound the database to the Google.com mapping capability. The combination of interpreting historical numbers as a prediction of future events is a natural and prevalent trend. And it is creating all sorts of unforeseen problems. To whit, some city police forces are now taking heat for biasing police patrol activity (shown on the maps) away from the major gang criminal activity (also shown on the maps). Wonder why? Even police like to go home alive at the end of the day. If you allow yourself to engage on observations like this, it quickly makes you ponder the purpose of a police force.

    Socialization of responsibility

The proposed tax system levies the legal requirement of tax collection on entities less flighty than an individual. It’s true that larger partnerships tend to be more compliant. For example, the military knows this and implements a two-person concept on certain highly classified accesses or activities. No one person is ever given unmonitored access. For instance, nobody drives around by themselves with nuclear weapons. No pilot has ever flown with a nuclear bomb, with full release capability alone. In the financial realm, the IRS knows that companies tend to respond better and be more compliant because they’re easier to drag into court – more accurately, that they have more to loose if they don’t show up in court, and they’re easier to find. If the collection effort is levied on a company, there will be tremendously less hassle and loose ends.

And in a fully socialized society where you’re defined by, and processed by computer batch programs, my friend, you (the individual), are a loose end.

Posted in General, Spirit & Heart | Leave a comment

Low Hanging Fruit

I was sitting in an XP (Plans and Programs) division meeting the other day, and I heard the statement, “High Power Microwave low hanging fruit is not on air platforms (and therefore we should pursue something else in the short term).” It’s not the first time I’ve heard this phrase. It is also used as a justification for prioritizing acquisition efforts.

What’s this “low hanging fruit” syndrome?! When proposing for funding support, we choose to go only for what we know we can get? The idea refers to an animal, walking on all-fours, stretching upward to eat from the trees. Much of the tree is inaccessible simply because the animal cannot reach it.

But we don’t walk on all-fours. Why don’t we lay a goal out before us and pursue it with resources? Okay, it won’t all be done in the first year, but we’ll get somewhere worth going rather than fill the file drawer with another decade of “who cares we did that?”

Posted in General, Spirit & Heart | Tagged | Leave a comment

My Business – Your Technology (012)

I sit and review Small Business Innovative Research proposals. Good proposals are ones that understand our business, in addition to their technology.

Posted in General | Leave a comment

The M&S Dragon (011)

Modeling and Simulation began to help engineers gain knowledge without building everything first. That was a good thing.

But the situation is changing. First, I’ve been hearing a lot during the last month or so about M&S needs of the HPM weapon community. Propagating terawatt energies in open air over changing terrain and through changing atmosphere is an RF modeling exercise worth years and $millions.

Then last Friday, I pondered flight test data needs with a pilot who’s been doing it a lot longer than me. He said the methods I proposed with a PDA and low cost integrated sensor package would be good for 1950s style aircraft characterization, but would never provide the fidelity to determine good Cm numbers that are necessary in modern simulators.

The light bulb came on. We weren’t taking data to know sufficient information about the airplane, per se. It wasn’t the FAA or military certification process that was driving our needs. Instead, a new dragon had been born. We were taking data to build a model that is better and more useful than the real airplane. The goal was to no longer need the inconvenience and expense of the real aircraft.

The net effect has changed. The T&E community is no longer benefiting from data M&S provides. Instead, the T&E community is now being driven by requirements for data M&S consumes. It is a new dragon in the industry, eating up dollars and schedules.

Posted in General | Leave a comment