About Me

Education, the knowledge society, the global market all connected through technology and cross-cultural communication skills are I am all about. I hope through this blog to both guide others and travel myself across disciplines, borders, theories, languages, and cultures in order to create connections to knowledge around the world. I teach at the University level in the areas of Business, Language, Communication, and Technology.
Showing posts with label feedback. Show all posts
Showing posts with label feedback. Show all posts

Tuesday, November 19, 2013

Tips on revision: The final edit

The final edits

These last suggestions are based on my experience as a peer reviewer for a journal and a writing teaching. I find that changing writing mode helps to pinpoint mistakes. I usually print out a hard copy to review. I ALWAYS find mistakes on print even if I have reviewed a paper digitally numerous times. The following are some of the more common mistakes I often see:

1) Make sure you review the style standards. This includes paragraphs, headings, and reference styles. Working across disciplines, I am familiar with the various styles you may be asked to use. if no style has been chosen, choose one style and stick with it. Often, though, there is a document you can model.

2) Make sure you paragraphs are not too long. I often read papers with page long paragraphs; this is too long. Review your document to see if you can break up overly long paragraphs.

3) Review, check, and recheck references in text and your reference list at the end of your writing. I usually do this with a partner to make sure I don't miss something. I will have them read out a citation which I check against my reference list, making notes on adjustments as I go.

4) Check figures, tables, and illustrations and their headings. Make sure they are close enough to the copy and/or there are references to them.

5) Check for orphaned lines/headings. One of my pet peeves is to have a heading end a page.

6) Write for scanning and search. Don't forget to include relevant key words. Also make sure a paper or report or even dissertation/thesis has enough sections and headings. Most people today don't have a lot of time. So the first thing they do is scan. This is where graphics, headings, subheadings, and short paragraphs help. If writing is too dense, you'll lose the reader from the very beginning.

7) Set a deadline. I mentioned this in my first post on revision tips and it is especially important as you end the revision process. Allow yourself only a short time to make revisions (i.e. 2 weeks). This will help prevent you from overthinking your revisions and trying to create the "perfect paper" which never gets published or presented to the appropriate audiences. You may need to make revisions a 2nd or 3rd time, but leave that decision up to the reviewers.

Monday, November 18, 2013

Tips on revision: Troubleshooting sections Conclusion

The conclusion

The conclusion is perhaps one of the hardest things to write; revision is even more difficult. As I mentioned in the Abstract section, the conclusion is tied closely to the abstract. If you are having difficulty revising the conclusion, try writing the abstract first. Then go back to writing the conclusion. This is especially useful if you have to cut out words. By keeping your conclusion close to the abstract, you conclusion becomes more focused.

So let's just review the purpose of the conclusion. The conclusion is the last thing your readers will read. However, realize also that many readers will stop reading at the findings/discussion. So while it is important to have a conclusion, it is not important to put in too much. Also, the conclusion should reinforce your message/thesis that you established throughout the paper. If you have hypotheses, it should summarize what your research has found. Therefore, the conclusion should 1) match your introduction and body, 2)NOT have new information, and 3)be easy to skim for key ideas.

Anything that does not align with what you have written in the rest of the paper or ADDS information should be cut from the conclusion. It is especially important to see if your summary in the conclusion aligns with your stated goals for the piece you are writing set out in the introduction. If you have stated that your research is going to answer questions, have you done so? If so, what are the answers? If not, why not? (There are times when more questions come out of research than answers or failed research adds to lit but does not answer questions). If you state that you are going to present a theoretical framework, did you do so? Did you explain the relevance or use of that framework to the field? If you have hypotheses, have you summarized the results in one or two lines? If there are hypotheses you were unable to confirm, have you explained why?

The final two lines or so should let the reader know what you want them to do with your research. If you receive comments like "How is this relevant" or "Not sure this research is useful", you have not let the reader know what the relevance is for them. If you want them to use the framework, for example, to conduct further research, you need to state that. For proposals and reports, you need to tell the reader what you expect their next step will be and how the report or proposal is relevant (will support the reader's work). This will be the last thing they read and you want it to be fixed in their mind.

Sunday, November 17, 2013

Tips on revision: Troubleshooting sections: Body of writing and visuals

Body of writing

Academic writing, whether it be papers, books, dissertations, reports, or even proposals, need to prove that research and data is relevant, reliable, and representative. The body is where an academic does this. So if there are questions about your research, you need to determine if 1) you have described your data, analysis, and methodology in a way that the reader/reviewer understands (easily rectified if you haven't) or 2)the reviewer/reader has problems with your data, analysis, methodology, or underlining theories (harder to rectify).

In the first case, one recommendation I had in revising my dissertation was to write as if I were giving the reader instructions on how to replicate my work if they wanted to do the research themselves. Often we assume readers understand the methodology we use when in fact they may not. I have often had to look up the methodology as outlined by a specific author when reviewing articles or reports. If you don't provide citations or definitions/assumptions that have informed your research, you leave interpretation of your methodology to your reader. A good example is "grounded theory". There are many interpretations of how grounded theory can be applied. As a reader, I'd want to know what process you used and what was the basis.

In the second case, you may need to analyze where a reader might be having a problem and decide if you are going to make changes. If you decide not to make changes, you need to justify your choices to support that your research is relevant, reliable, and representative. One article I wrote was consistently being rejected by one reviewer in particular. In the end, his basic theoretical beliefs were different than ours (I had a cowriter). Because of these differences in beliefs, he would never accept any of our published material/methodology. We were pushing a new view of an established theory. However, we did realize in the first and second revisions that we needed to address the need for a new perspective and method of analysis for the readers or many would have the same reaction. We had to demonstrate first that we understood the prevailing theory and then present an argument for looking at it from a different angle. This way, the audience would not evaluate our article as being uninformed, but rather a new perspective (which they still might have disagreed with). In the end, our revised justifications for our methodology and the basis for analysis convinced the editor to publish over the opinion of the reviewer. It also helped that the other two reviewers changed their opinions about the article so that by the 3rd revision, they were strong supporters for publishing the article.

Once you have written a description of your process(es), it is important to include analysis. New writers and researchers in particular, are adverse to presenting their own interpretations. As a result, the body of a report, dissertation, article, paper, or even book becomes a compilation of facts. It is difficult to realize that feedback may want more of your educated opinion based on your analysis rather than more facts. I see this often when reading articles written by practioners or graduate students where they may not have ever been encouraged to draw their own conclusions. Going back to communication/rhetorical theory, you need to make a claim in your writing. This can be a conclusion, observation, hypothesis, or theory/model. Without the claim, your writing only is descriptive or data. If the feedback you have received includes questions such as "what does this mean?" or "how is this relevant", you have not made a strong enough claim. Likewise, if you have been asked to cite one of your own claims, then you have not made it clear to the reader that this is your claim based on your analysis. Even seasoned writers have this difficulty and you need to take possession of your original ideas in your writing.

Another related problem is supporting your claims. While you may have good reasons for making your claims, most readers will need to be guided through your thought processes for a claim. It is not enough to make a claim and follower up with data in a table. Rather, you will need to point out relevant data and how that supports your claim. If you have feedback such as "Why is this relevant?" or "Can you support this?" (even though you have listed the data), you need to work on explaining how data supports your claim.

Another aspect of revisions of the body is choice of visuals to support your written analysis. I was reminded of the APA guidelines that visuals must be relevant and augment, not replace your writing.
As the Purdue OWL says:

Visual material such as tables and figures can be used quickly and efficiently to present a large amount of information to an audience, but visuals must be used to assist communication, not to use up space, or disguise marginally significant results behind a screen of complicated statistics. Ask yourself this question first: Is the table or figure necessary? For example, it is better to present simple descriptive statistics in the text, not in a table.

Don't assume reviewers won't look at your visuals and tables. Often they will ask you to reformat, add, or delete information that is not necessary. I had to simplify a model I had for my dissertation because it was too complex to follow. Instead, I broke the model up into smaller components which my readers found easier to follow. Of course, sometimes if you have word/space constraints, your first inclination is to put everything into one visual. It is better to simplify so there is a general visual and leave the details for your text when you can relate it to your analysis. Another possibility, if you want the data accessible, is to set the data on a website which you can give readers access to through a note. On the other hand, sometimes a visual will allow you to cull full sections. I just read a revised article that used a visual to explain the various variables used in the study and their relationship to each other. The original version had the explanation in the text which covered 6-7 pages. By the end of the section, I was confused as to how the complex research all related to each other. The one visual allowed the author(s) to cut this section down to 2 pages with a visual, which gave me a better understanding of both the complexity, relationships, and structure of the study.



Saturday, November 16, 2013

Tips on Revision: Trouble shooting sections: Introduction and Background/Lit review

Introduction: What goes into the introduction may vary stylistically depending on length, discipline, and purpose. However, a good introduction will allow the reader to decide if they want to continue reading. When you have been asked to revise the introduction, the first thing you need to determine is was this the result of your writing not being focused or clear enough or is this the reviewer wanting you to change direction or refocus your paper? If it is your writing, you need to go back and reread your paper, especially findings/conclusions to make sure your introduction aligns with the rest of the paper.

It might help to do your introduction revisions last. This way you can frame your paper so the reader knows what to expect. This is contrary to your first draft where you frame your paper so you can write. Revisions usually move towards the reader's ability to understand what you write. So leaving introduction revisions to the end means you have a better idea of where you want your reader to end up.

Background/literature review

Often times, we have made claims or framed our paper based on previous theories, but then find that our research does not fit with those theories. This is the section where those that must cull words can do the most culling. This is also the section where you need to craft how your research is relevant.

1) If you are using hypotheses, make sure your develop how previous research supported the development of your hypotheses. This is where you explain you logic in developing the hypothesis, supporting it with research. You don't need to include all the research you have ever read (especially if there is a word limit or the piece is shorter; this is not necessarily true for a dissertation or thesis where breadth of literature is important) but only those pieces that had the most impact on your hypothesis development.

2) If you are using research questions (usually qualitative) to organize literature, use only the research that was relevant in creating the questions or will support the questions you asked.

3) If you have findings that you did not initially anticipate, you need to go back and revise your background information to explain your findings. During my dissertation, my focus was moved from collaborative writing to knowledge creation. As a result, I had to go back and see what the literature was on knowledge creation. I realized that in reframing my question (the question was the same, the answers were different than anticipated and a different discipline explained the answers better), there were no theoretical frameworks for the type of research I was working on. I ended up creating a framework based on the literature I collected AFTER my analysis. This is not an indication that you had a problem with your initial research but rather that you kept an open mind and did not change the data to match your assumptions. This is an attribute of good research.

4) Target any new literature searches to only those areas feedback has indicated as weak. Academic writers have the tendency to want to find new literature which might take them into new areas or give them new understanding of the topics. That is fine for the first draft. But the 2nd and 3rd drafts only need research that supports or frames their hypothesis/message/research questions. One thing I've found helpful is to save new ideas/literature for future articles by writing up memos I can revisit. This way, I don't feel as if I'm missing anything.

Friday, November 15, 2013

Tips on Revision: Trouble shooting sections: Abstract/Executive summary

Troubleshooting sections

If your style is more working section by section, here are some tips for each section.

Abstract/Executive Summary: ECPublishing had a great insight into the importance of your abstract:
Make sure your abstract and title truly reflect the content of your paper and are written well. You need to sell your paper and its significance. We can’t rewrite your abstract to make it more attractive to reviewers; you need to make it concise and full of impact.

Although this is the first thing read by most readers, it is often the last thing written. Many people are afraid to give the results/conclusions of the paper because they want others to read it. However, without results/conclusions, a reader will not know if the paper is relevant. In fact, I never download a paper where I'm not sure what the results are. I tie the abstract closely with the conclusion of a paper. It forces the conclusion to be focused and it makes the abstract relevant to your paper's message. Another way to think of it is: If someone were to ask you what your paper was about and what impact it has for researchers in 5 sentences, what would you say? This is why most people say to write the abstract last.

One of the main problems in revisions, however, is that your message/conclusions and how you word them may change. If you have a teacher/supervisor/editor who wants you to shift focus, you may rewrite your conclusion. Remember to revise your abstract also.

Friday, November 1, 2013

When, how and who to ask for academic writing feedback #acwrimo

In honor of Academic Writing Month (#acwrimo), I have decided to write a weekly series on feedback/revision/editing. This is an often overlooked, yet important, aspect of academic writing.

So now you’ve written your piece or perhaps you’re in the planning stages. It’s your work, so you want to maintain ownership. However, you also know you’re going to have to have your piece reviewed. Who do you ask? What type of feedback should you get before you submit a piece? How do you get feedback so that you maintain ownership of your scholarship, yet still are able to produce a publishable piece?

First, recognize that there is a difference between writing you do as a student compared to writing you do as a professional academic or researcher. As a student, you are writing (for the most part) to be evaluated on your knowledge of a topic. Therefore, when you write, there is a piece of you that goes into your writing. If your writing is evaluated as lacking, it reflects on you, the student. It is important as a student that you demonstrate what you know to the evaluator (teacher, evaluator(s), dissertation committee).

Professional writing, on the other hand, is to provide information/a view point/research to a readership that may be interested. As a result, peer reviewers and editors want your writing to align with the expectations of the readers. They are not looking at WHO wrote the piece, but the written piece itself. If they reject or want you to change something about your written product, they are not rejecting you as a person (many times, especially in blind reviews, they don’t even know who you are), but your writing, ideas, or the appropriateness of the writing for the audience they represent.

When to ask for feedback

This depends on how you write. I like to ask for feedback in the planning stages. I know of colleagues that send ideas to publishers and editors to ensure it is viable or get suggestions on how to frame a piece of writing for a particular audience. This can save you a lot of editing in the long run. On the other hand, if you are someone prone to writer’s block, this type of feedback could build the wall up to reinforce the writer’s block.

Book writing is very different than article writing. Often you need to submit an outline which includes an audience and justification for publishing. This is when feedback from colleagues or others in your profession come in handy. Identify some experts to submit your outline to for feedback. If you are in a very competitive discipline send them the general concept (as opposed to a fully developed proposal). Their feedback can then become part of your proposal.

Before you submit a first draft, have someone unfamiliar with the topic review what you’ve written. They can assess the clarity of your writing without having to analyze your content. Then you may want an expert to review your piece for the content/theoretical basis. It helps to identify for your editor/reader what you want them to look for. If you don’t ask them to correct typos or grammatical errors, don’t expect that they will do so.

Finally, expect you will need to make revisions. Sometimes this helps take the pressure off to be perfect which can create writer block. If the draft you submit is not perfect, don’t worry. Even if you think it’s perfect, most likely the peer reviewers will have suggestions. Don’t take this feedback for publication personally as the reviewer is probably just trying to align your writing to reader expectations. Once you get suggestion back, review each piece of feedback. It is not necessary that you make changes for everything suggested by reviewers. Rather, think of what they are saying and keep those things that you feel are important to keep. If you have reviewers that are contradicting in their feedback, work with the editor to determine what he or she wants you to do. The editor has the final say.

Conclusion

So, 1) Don't be afraid to ask for feedback at any time during the writing process;
2) You don't have to accept everything a reviewer suggests, but you do need to consider his or her comments and be able to justify your choices;
3) Have at least one person who knows nothing about your topic review your writing for clarity;
4) During the formative writing process, tell your reviewers/readers what you want them to focus on in their feedback;
5) Don't take feedback personally, especially if you are writing for publication.

Tuesday, May 10, 2011

Using students to keep current on research

I know I have not posted anything in a while (and probably won't after this post). However, I currently am buried in grading papers from two different classes, trying to get final grades in as it is the end of the semester.

As I was reading through my student papers, I realized they had a wealth of research that I could use both in my dissertation and in my classes next semester. I have decided that texts don't have what I am looking for in my classes. I have begun to tailor the readings to my classes and assign readings from journals and academic websites. To do this, however, I need to stay current with the research. This is difficult at times, especially when I have pressing family, work, and academic responsibilities.

I have begun to cull promising articles from the resources my students used to write their final papers, an expanded reflection on a topic (or topics) of their choice within the course. I use these papers to help direct changes to the course (areas of interest to the students and areas that I might see as lacking, that perhaps I did not address in the class).

Based on my evaluation of their papers, I will then try to find new resources to address those areas I feel my course needs improvement in and come up with new activities that I can use in my class.

One area many of my students wrote about was virtual teams. Many also wrote about social loafing (always a big topic for groups used in education) and decision making. With this in mind I have decided on trying to integrate two new activities in my class next semester:

1) The virtual/online class I teach often is difficult for the students. I have been dissatisfied about the task I give them to work on. It seems unorganized and students are often confused (although that is part of the task that I want them to learn from). I have decided to expand their task from one of "introductions" to one of sharing information. After reading Jenny Luca's newest post, I decided I would have each group search for a specific item/information and then combine their findings online. This way I can have them work together using a wiki or googledocs, and hopefully see how search engines filter results depending on individual preferences. Hopefully, the groups will be diverse enough that their results will be different. If not, we can address the idea of groupthink.

2) I am going to include a peer review grade in one of the projects. The two projects I set up for my group communication are different tasks with different communication requirements. One is a very structured task in which group members are assigned specific tasks and are given an individual grade for their work within the group. The second task is ill-structured, using a student generated code of conduct, student determined project, and meeting minutes or other written form of communication to document the group work. The first is teacher directed whereas the second is student generated. The two projects overlap with the intention being that students experience two different types of groups and the communication needs that different environments require. Because the second project does not have an individual part to it, there is a lot of social loafing to the project. I have tried to get students to create a code of conduct in which they generate some form of evaluation, but students do not perceive that they have the ability to enforce their code through grades, etc... So I have decided that their code of conduct will have a peer review piece that they will then review at the end of the semester and hand it for grading individual members.


I have no qualms of using my students to do some of the leg work needed to make my classes better. This is the type of student feedback that I feel is important and much better than anonymous questionnaires asking students "how do you like the class".

Wednesday, December 1, 2010

Classifying feedback

My laptop battery is not working, so lately I have been hand writing all of my perceptions as I analyze my data. However, my work yesterday resulted in an insight I wanted to share. This is still a work in progress, so I am open to any research that someone might be able to point my way.

In describing the collaborative process, many of the participants (members of the distributed group) used the word "feedback" often. However, I soon began to see that feedback could be a source of tension, a helpful tool, or something that was ignored. Sometimes it was solicited, other times it was given without any prodding.

Now, most of the previous literature on feedback has divided it into positive or negative, summative or formative, or oral, written, or non-verbal. However, none of these classification systems really fit the types of feedback I am seeing in the collaborative writing process.

Defining feedback

To understand these classifications, it is important that I define the term "feedback". I am using a communicative definition. In the communicative act, there is sender and a receiver. The Sender initiates the communicative act and the receiver decodes the message as they receive it. However, the communicative act does not end there. The receiver gives feedback based on his or her interpretation (decoding) or the message. That feedback could be as simple as silence (or withdrawal from the conversation) or much more complex.

Based on this definition, I see feedback as the communication between the "giver" of feedback and the "receiver" of the feedback. The feedback could be verbal or non-verbal, formally requested or the natural result of the communication process.

Four types of feedback

I have (so far) identified 4 different types of feedback within a distributed workplace group or team. The type of feedback depended on the amount of ownership or the level of agency the feedback giver perceived. It also was effected by whether the feedback was formally solicited (as part of the work process) or was given in response to an informal communication act (written or oral).

1) Creative feedback. This makes the feedback giver a co-creator. In other words, there is a high level of perceived ownership and agency from the feedback giver.

2) Editorial. This is usually the result of a formal feedback mechanism within the work process or a heuristic created at the group, organizational, or professional levels. The feedback giver often has more distance between his or herself and the feedback receiver, and has less ownership of the task/process or product. As a result, feedback might be accepted or not by the feedback receiver without any influence between the feedback giver and feedback receiver.

3) Confirmative. There usually is a power distance between feedback giver and receiver when confirmative feedback is given (for example, a team leader and a team member). The feedback giver, as a result, will have a greater sense of agency, and by giving approval or confirmative feedback, he or she takes partial ownership (whether the feedback receiver wants to give it or not).

4) Political. While the feedback giver might have thought that they had agency, the feedback receiver holds all the cards and could decide to take ownership, give it to the feedback receiver (or force it on to the receiver) or become co-creator. Political feedback is often used to document the communication process, identify responsibility for work, tasks, or products, and to make the work transparent to those outside of the process/task.

These different types of feedback can be used to unify a group and make the work processes more efficient. Using the correct type of feedback can also improve the final product, expedite the group process, and create a sense of trust within a group (especially important with a distributed group). However, in my study, when there was a difference in the perception of the type of feedback being solicited, tension was created between the giver and receiver, which could result in resentment (especially if the giver or receiver did not recognize the difference in the feedback being solicited).

For example, two of the study participants had the following discussion during the group interview:

Ronda: Well, exactly that. And I think it’s that…there’s two things that are sort of complating that…that problem. This notion that have sort of too many cooks looking at your project. And then that there’s no level of authority assigned to, um, whatever you put up there. Like when s….when I put something up for review and people send me editorial comments, I personally, because I’m arrogant and snotty about this stuff [everyone laughs], don’t feel like because he said this or he said that or he said that or he said that, that I have to change it. You know. That’s not their job, in my opinion is not to tell me how to change it. Because this is my expertise. I’m putting it up there for a different kind of review. And…I don’t always feel obligated to take that feedback. But somebody else might put something up and say, “Well, you know, what do you think of this design?” And then there’ll be c…comments from Helen and Robert and Phillip and… Make one change. Then the next person comes and says, “Do this.” Then they’ve changed it back. Or change it this way. And it’s…just turns into this huge morass of inexpert opinion shaping products that shouldn’t be doing that. So there is this level of disrespect for people’s expertise, which you subject yourself to by putting stuff on basecamp. On the other hand.
Phillip: You know, Ronda, it’s interesting that you say that, cause sometimes the process is, eww, should I comment on it or is that going to [anger] her?
[Everyone laughs}
Ronda: Yeah, and I don’t ever feel like that!
Phillip: I don’t know.

And later:

Phillip: When you take my sentences and change them, I go, “Wow, that’s…that’s a better sentence.”
Ronda: And that’s…that’s…that’s my j… That’s not personal. It’s not, you’re not a good writer…
Phillip: Right.
Ronda: It’s not any of that. It’s my skill.

In the first case, Ronda is asking for editorial or confirmative feedback, but she gets angry when she gets creative or political feedback. On the other hand, Phillip is reluctant to give creative or confirmative feedback because he does not feel that it is his place in the group to do so. As a result, he tends not to give feedback very often, referring to others to give feedback even when he has the expertise.

Note: See the post by Karyn Romeis on workplace collaboration. This framework for feedback might explain the problem she describes in her post.