Ok - these posts are getting ridiculously large so I'm going to try to be succinct and I guess I won't be able to address everything. On some things we'll really have to just agree to disagree because there are so many ways to approach this subject, and at the end of the day, some ways are suitable for some people and others for other people. I'd be interested to know if any innocent bystanders monitoring this thread have opinions on what they consider of use to them and other ways that they approach improvising and soloing.
So, the only point I'm going to debate is this one, which I think lies at the heart of the matter:
Improvisation, be it advanced or not, will have to be played by ear.
It is my belief (and I am not trying to be confrontational for the sake of it) that this is too broad a generalisation and simply cannot capture 'improvisation' in such a simplistic manner.
Now, don't get me wrong - my allegiances actually lie in the *same* camp as those of Ablue - that is, where true spontaneous improvisation (that is, music that is made up on the spot with no pre-meditation) *should*, in a purist's sense, be 'heard' in the head at the same time that it is played (or a microsecond before), but I think that there are practical limitations to this in that everydbody has to start somewhere in learning what all the sounds and pitches producable are and cannot jump from novice to expert with no training in-between (incidentally, knowing scales and modes is NOT any kind of shortcut). Close inspection of my 'this is good advice' post will hopefully cover my tracks.
I think that this (Ablue's definition) is too narrow a scope for improvisation, and frankly it surprises me that more people haven't put up their hands and said "hey - that means you're saying that what I'm doing *isn't* improv!" I think that it is totally valid for a musician without a well developed ear to be able to improvise based purely on the shapes of scales and chords under his or her fingers. If I am taught a C major scale on the first day of picking up a guitar, and I have enough creative juices within me to think "hey, these needn't be played in a strict ascending or descending order, but I could play them in a different order!" then
I AM IMPROVISING and I need not necessarily be able to hear those lines in my head before they come out. Moving a step further, I can improvise by knowing the key chord tones of my target chords and know when I should land on them based purely on shapes, and so long as I stay within the scale (of which I have foreknowledge) and even if I deviate, but come back to my chord tones, then what I'm doing will sound ok. Again, I need not necessarily know what every note is going to sound like in context before it's played, but again, I would still be improvising.
Absolutely I believe this - and I'd bet (but cannot prove) that *most* improvising musicians do this to a large degree, using muscle/finger memory for a large part and a strong knowledge of the fretboard or UI of whatever instrument they play - especially for very fast passages. (P.S. Holdsworth relies heavily on a visual technique in which he 'sees' all the notes of the scale he wants to use as if they were lit up on the fingerboard.)
One thing I absolutely agree with you wholeheartedly on is the development of the ear through transcription (I used to spend hours listening to the same 10 seconds of music). This is an entirely new subject in itself, which we should devote a new thread to.
Well, I have to go to play my guitar now. I've spent more time on this forum in recent days that I have with my instrument - you can see how passionate I am about music... One thing that I've really taken away from this discourse is how much it has really made me think about what it is that I do - so thanks for the engaging replies - this is helping me move to the next level.