Map 3D 2008 only importing half a shp file??

[guyver1]

Im having problems with a shp file from OS landline (please see the attached images)

In Arc GIS the shp file displays correctly

when i then switch over to Map 3D 2008 and use the Data\Connect to Data\Add SHP Connection it only imports around a 3rd of the data.

If i then use File/Import/shp it will import the whole shape file but it wont add it to the Display Manager and i cant access the table data etc.

Why is the Data connect broken in this manner? I dont get any error messages i just a partial amount of the shape file inserted into my drawing which is useless :(

any help would be greatly appreciated

[Jmurphy]

A few things to try, make sure you have all updates for Map3D, clean out the temp cache folder used for Map3D, look for a file with an extension of idx named the same as the shp file and delete it.

[guyver1]

Map 3D up to date.

flushed cache and deleted .idx file

still the same :/

As a precaution i checked the table data in Arc GIS and it shows 224035 entries

I checked the table data in Map 3D and it to shows 224035 entries, so why isnt it importing all the lines into model space?

The 8 other shp files i have for this map all import fine

[Jmurphy]

If I recall there was a limit on the display of features(number displayed), in 2009/10 they set that up to the higher number. The link here talks (http://usa.autodesk.com/adsk/servlet/ps/item?siteID=123112&id=10408989&linkID=9240857)about labels but you may want to check you system and see if there's another Hkey to edit.

[guyver1]

thanks for that, I'll have to try that when i go back into work on monday morning

[guyver1]

ok for some reason i dont have the registry key as set out in that 'fix'


HKEY_CURRENT_USER\Software\Autodesk\AutoCAD\R17.1\ACAD-6002:xyz\GIS\AcadMAP

I dont have the \GIS registry entry at all.

The company I'm doing volunteer work for is using an educational version, are there any limitations attached to educational versions?

Is there a web page with those listed and could this be an issue with importing large shp files with a large number of entities?

[Jmurphy]

Ok I just looked on my system, I don't have the GIS Keys either for the 2008 versions, but do for 2009 & 2010 versions. :?: The education version should be the same as the commercial versions in this matter. You issue may be video card/driver related, is the card and drivers on the list of supported from Autodesk?

[guyver1]

Its an nVidia GeForce 6100 running the latest nvidia drivers

tried running in Direct3D and OpenGL, no difference

I'll upload the shp file tonight to my webspace so you can try it on your system

[Jmurphy]

Its an nVidia GeForce 6100 running the latest nvidia drivers

tried running in Direct3D and OpenGL, no difference

I'll upload the shp file tonight to my webspace so you can try it on your system

I do not see the 6100 card listed on the Graphics Hardware List (http://usa.autodesk.com/adsk/servlet/hc?siteID=123112&id=6711853&linkID=9240618&is_results=1&card_sel=0&manufac=4318&card=0&cert=1&d_stat=1&d_stat=2&prod=AutoCAD-R17.1&os=1&os=2&os=256).
Let us know when you upload the file(s).

[guyver1]

http://www.leonlive.co.uk/stuff/building_outlines.zip

[Jmurphy]

Looks like your video driver/card or display issue. Even though you only posted the one file ESRI shape file format contains at least 3 files xx.shp, xx.shx, and xx.dbf. I was able to data connect to it and it displays everything for me.

[guyver1]

ok mate, thanks for your help. At leasr i know its a hardware issue now and i can get a case together for an upgrade.

[guyver1]

what GFX card are you using out of curiosity?

GeForce or Quadro?

and what model?

cheers

[Jmurphy]

GeForce 8400 GS, the original one that came with my home system a few years ago.
You might be able to fine tune your settings to work. In AutoCAD enter 3dconfig at the command line and select manual tune, toggle hardware acceleration a few times and a few other settings and see if that makes a different

[guyver1]

na doesnt make a difference

looks like I've put together a convincing enough case for them to upgrade the CAD machines to nvidia Quadro FX580's and 4Gb of RAM

I'd just like to make 100% sure that this display error is 100% because of the gfx cards (3 machines with same display error as noted here, on 3 diff cards, GeForce 6 6100, Geforce5 FX5200 and an ATI 7500) and not some random windows setting or autocad setting.

You've been extremely helpful so far so thank you for that.

How much RAM are you using? do you have a way to drop your machine to under 1Gb? that would emulate my office machines which are only running 512mb or 768Mb.

Would like to rule out a lack of RAM

[Glenn Pope]

my office machines which are only running 512mb or 768Mb.
:shock: Wow! Amazed you are able to have Map run at a workable level. Even if this doesn't fix the issue, you'll love to speed increase of this.

[Jmurphy]

The recommend RAM for 2008 was 1 Gb to start with.

[guyver1]

:shock: Wow! Amazed you are able to have Map run at a workable level. Even if this doesn't fix the issue, you'll love to speed increase of this.

who said anything about 'workable'.....

I'm just doing voluntary work for this charitable company and their hardware is archaic to say the least.

Its only since I've been there and pointed out all the flaws in their hardware and hows its affecting their software performance that they're actually sorting out some sort of upgrade for the 3 CAD/GIS machines

The main engineer is on an ancient Socket A AMD Athlon 1.8Ghz Thunderbird with 512mb RAM and an ancient ATI 7500!!

[guyver1]

Update:

got an 8400GS installed with the latest nvidia drivers and its still the same :(

machine has also now got 2Gb of RAM.

Im pretty much stumped now as to what is causing this problem :/

[Jmurphy]

Try cleaning out the users temp folder and map cache folder, setting the page files up a bit more. Turn off hardware aceleration in the 3dconfig command.

[guyver1]

all temp files/folders cleaned ( i use a variety of cache cleaning programs)

tried running 3dconfig in all 3 modes, software, Direct3D and OpenGL

Pagefile is set to 1Gb fixed size (I've set my pagefile like this for 10 years now as it stops disk thrashing with a variable pagefile size.

still the same :cry:

I'm strongly beginning to suspect this isnt a GPU issue but something else, i just dont have a clue what

[Jmurphy]

Have you tried in a new dwg and when you add it to the map are you sure there in no location query being done on the shp file?

[guyver1]

everytime I've tried inserting this particular shp file its always been into a new drawing. I get no messages or queries of any kind that i can see. F2 is blank and shows nothing untoward.

Log file shows this:




[ ADE - 19 October 2009 09:58:27 ]----------------------------------------

[ ADE - 19 October 2009 10:26:42 ]----------------------------------------

[ ADE - 19 October 2009 10:28:26 ]----------------------------------------

[ ADE - 19 October 2009 11:49:35 ]----------------------------------------

[ ADE - 19 October 2009 13:03:50 ]----------------------------------------

[ ADE - 19 October 2009 13:06:12 ]----------------------------------------

[ ADE - 19 October 2009 13:09:22 ]----------------------------------------

[guyver1]

the problem shp file as i sent to you is 31Mb, I just added a 76Mb shp file from the same UK landline OS data and it connected 100% fine with only this in the log file:





[ ADE - 19 October 2009 13:26:58 ]----------------------------------------


Log file shows no errors or differences between the bad import and the successful import

[guyver1]

Ok, I've tried everything.
Changing the nvidia control panel settings:
Triple buffering - on/off
Vsync - on/off
texture quality - high performance/performance/balanced/quality/high quality
AA and AF at all settings.

I've also tried the 3dConfig in all 3 modes - software, directX, OpenGL
all with their options on/off and also switching the "Emulate unsupported hardware" on/off.

I've pretty much exhausted everything in my knowledge as well as trawling google.

The 8400GS is going back, and hopefully will be getting a Quadro in the next few days.

All the entities show up in the table. I've also used much larger shp files as in my previous posts and they display fine. The 76Mb shp file has 485,227 table entries that display perfectly, while this bad shp file is only 30Mb and only has 224,035 table entries but yet wont display correctly.

UPDATE
In task panel. In the display manager tab the shp layer table shows the full 224,035 entries.
If i then go to the map explorer tab and expand SHP_1/default/building_outlines and select 'show data table' it only shows 91,126 entries

RAM is no longer an issue as the machine now has 2Gb.

This issue is being repeated across 3 different machines in the office with 3 different specs of hardware.

frankly i'm totally stumped

This machine is using an Athlon64 CPU and uses the a modified boot.ini as follows:




timeout=30
default=multi(0)disk(0)rdisk(0)partition(1)\WINDOWS
[operating systems]
multi(0)disk(0)rdisk(0)partition(1)\WINDOWS="Microsoft Windows XP Professional" /noexecute=OptIn /fastdetect [B]/usepmtimer


Have there been issues with Map 3D and any CPU types?

I mean i'm clutching at straws heres.

I dont understand how Cad can render over 400,000 entities correctly in one shp file but cant render just over 200,000 in another......

[guyver1]

ok i've just done another test.

I opened the table for this particular file in Map, and selected all.

I dragged the table down so i could see the selection and i can confirm that it highlights ALL the entities correctly.

So I can confirm that all the entities are actually present in the drawing.

is there some way that CAD could insert some sort of clipping plane for any reason, or a wipeout? given the shape of the import it looks like a clipping mask has been put over it.

[guyver1]

Ok so another test and a bit of success.

I imported the shp file via File/Import/Import.

I checked the data and the shp file is made up of roughly 50/50 lines and polylines.

I purged the drawing and there was a lot of stuff purged (although the only stuff purged was my title blocks, a few layers and a load of dimension styles).

I then did a file/export and saved the drawing as a shp file again but with a different file name.

I then opened a fresh new drawing and tried to connect to this new shp file and voila! i got the full shp file displaying correctly.

So......

why do my 3 office systems not like whatever was purged out of the drawing and then display the shp file incorrectly.

Obviously the downside to my method above means i no longer have any metadata at all in the new shp file.

Is there an autocad system variable that could account for this behaviour?

[guyver1]

just doing a bit of reading here http://docs.autodesk.com/ACD/2010/ENU/AutoCAD%202010%20User%20Documentation/files/WS73099cc142f4875513fb5cd10c4aa30d6b-7f42.htm

could it be possible that my office systems are missing 'other' files that are needed to display this shp file correctly, such as font shp file or something like that? or a specific linetype etc etc.

[Jmurphy]

just doing a bit of reading here http://docs.autodesk.com/ACD/2010/ENU/AutoCAD%202010%20User%20Documentation/files/WS73099cc142f4875513fb5cd10c4aa30d6b-7f42.htm

could it be possible that my office systems are missing 'other' files that are needed to display this shp file correctly, such as font shp file or something like that? or a specific linetype etc etc.
No, those font/shape files that are being referred to in the link have nothing to do with ESRI format shape file. Your issue has more to do with the 2008 version and how it uses the display/memory on your system and a few bugs in 2008 that got worked out in 2009/2010.

[guyver1]

No, those font/shape files that are being referred to in the link have nothing to do with ESRI format shape file. Your issue has more to do with the 2008 version and how it uses the display/memory on your system and a few bugs in 2008 that got worked out in 2009/2010.

are you not using 2008? is this why your system can display the shp file correctly?

[Jmurphy]

I used 2010 the first time, I was able to open it in 2008 and it displayed what you see at first, but if I wait a while it dispalys everything. I also opened it in ArcView 3.2 version and it will diplay as you see it it in 2008 at first but then displays everything. Looks like a bad shp file.