Sign In
    Wisconsin Lawyer
    December 01, 2001

    Wisconsin Lawyer December 2001: Economics of Practice Survey Methodology

    Survey Methodology

    Constructing an unbiased sample. When reviewing survey results, it's wise to remember one simple rule: A biased sample will produce biased results. It is the goal of every legitimate survey researcher to construct unbiased samples. While completely excluding all bias is almost impossible, several measures can be taken to reduce sampling error.

    A sample should accurately reflect the target population. In this case, the target population was all attorneys in Wisconsin who were identified in the State Bar of Wisconsin membership database as having active status. Due to time and budget constraints, it was necessary to choose a smaller, representative sample that would reflect the larger population of attorneys. To ensure appropriate geographical representation, the sample was stratified, or subgrouped, into six regions based on county. A small number of attorneys with "unknown" occupation were added to the samples within each region to account for the total number of active attorneys in the region, and reduce nonsampling error. The total sample numbered 3,741 attorneys.

    Looking at the responses. A total of 890 usable questionnaires were returned for a 24 percent response rate. Respondents represent a variety of practice types including private practice, government agencies, the judiciary, in-house counsel, and those working in legal aid or as law clerks. The survey maintains a 95 percent confidence level, with an error of estimation of plus or minus 3.2 percent.

    All survey researchers hope for a high response rate, although there is no "standard." A 24 percent response rate, while lower than desired, is typical of what the Bar has been seeing when surveying attorneys who have increasing demands on their time. The somewhat sensitive nature of the survey topic also may have contributed to the response rate. It is important to realize that 24 percent, in this case, reflects the input of nearly 900 Wisconsin attorneys.

    When evaluating response rates, the main question is, "How closely does the sample match the rest of the target population?" One way to get a handle on this is to compare the demographic attributes of survey respondents with those of the target population as a whole. Regardless of the sample size, the potential for nonresponse bias is a reality. So what's the best advice? Take survey results for what they are. Pay attention to survey methodology and review results with a critical eye.

    2001 Survey Report available. The Economics of Law Practice in Wisconsin - 2001 Survey Report is available for purchase. The special member price of $19.95 includes the report and any additional analysis specific to your individual practice setting or assistance needed in interpreting the information presented. Nonmembers may purchase the report for $59.95. To order the report contact the State Bar at (800) 728-7788.


Join the conversation! Log in to comment.

News & Pubs Search

-
Format: MM/DD/YYYY